00000001:02000400:0.0F:1787574071.296773:0:2953:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787574087.564263:0:3175:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1787574089.182873:0:3235:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 659 MB/s 00000001:01000000:0.0:1787574089.432411:0:3235:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 799 MB/s 00000001:01000000:2.0:1787574089.685333:0:3235:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4233 MB/s 00000020:02000000:1.0F:1787574090.457438:0:3267:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_80_g1214e44 00000400:02000000:1.0:1787574091.432260:0:3282:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.151@tcp [8/256/0/180] 00008000:02000000:2.0:1787574095.434467:0:3432:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787574143.936199:0:5235:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787574154.891241:0:5811:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787574154.891248:0:5811:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787574154.891379:0:5811:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000da8c6f1e 00000080:02000400:1.0:1787574154.891391:0:5811:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1787574154.896246:0:5811:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1787574154.896261:0:5811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787574154.896304:0:5811:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000003c96681d) 00000020:00000080:1.0:1787574154.896329:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787574154.940941:0:5811:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787574154.941926:0:5811:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0F:1787574154.978451:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787574154.978639:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787574154.978665:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787574154.978719:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787574154.978832:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787574154.979648:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787574154.979658:0:5811:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787574154.979670:0:5811:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfe91058e646bf457 00000020:01000004:3.0:1787574154.979679:0:5811:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787574154.979683:0:5811:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787574154.979688:0:5811:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000da8c6f1e from MGS 00000020:01000004:3.0:1787574154.979693:0:5811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787574154.979712:0:5811:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000af6d8e3c) 00000020:00000080:3.0:1787574154.979724:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787574154.979897:0:5811:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000da8c6f1e from MGS, refs=2 00080000:01000000:3.0:1787574154.980193:0:5811:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787574154.980202:0:5811:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfe91058e646bf465 00000100:00100000:3.0:1787574154.980307:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787574154.980445:0:5811:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787574154.980451:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787574154.981400:0:5811:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787574154.981408:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787574154.982426:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787574154.982706:0:5811:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787574154.982712:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787574154.983958:0:5811:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787574154.983970:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787574154.984603:0:5811:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787574154.984611:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787574154.985825:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574154.985830:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574154.985832:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574154.986152:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574154.986154:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574154.986156:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574154.986888:0:5811:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787574154.988777:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787574155.236620:0:5811:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2271 MB/s 00000001:01000000:1.0:1787574155.486266:0:5811:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4767 MB/s 00000001:01000000:2.0:1787574155.736312:0:5811:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1071 MB/s 00000001:01000000:0.0:1787574155.987442:0:5811:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1151 MB/s 00080000:10000000:0.0:1787574156.013233:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1787574156.025433:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787574156.056908:0:5811:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787574156.057478:0:5811:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787574156.057483:0:5811:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787574156.066268:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787574156.066614:0:5811:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787574156.066687:0:5811:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1787574156.067143:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787574156.067211:0:5811:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787574156.069989:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787574156.071684:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787574156.071851:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787574156.072627:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787574156.072636:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787574156.073006:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787574156.073015:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787574156.074081:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787574156.074105:0:5811:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.151@tcp' 00000020:01000004:3.0:1787574156.074107:0:5811:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787574156.074163:0:5811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.151@tcp (typ=mgc) 00000020:00000080:3.0:1787574156.074237:0:5811:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.151@tcp (00000000a701376c) 00000020:00000080:3.0:1787574156.074255:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787574156.074348:0:5811:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c328d944@MGC192.168.206.151@tcp: add connection 192.168.206.151@tcp at head 00010000:00010000:2.0:1787574156.074938:0:5811:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.151@tcp-0 is initialized 00000040:01000000:2.0:1787574156.074952:0:5811:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 1 is initialized 00000100:00080000:0.0:1787574156.076114:0:5826:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787574156.085552:0:5827:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787574156.085746:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.151@tcp (uuid 7182851c-b624-4982-87cf-e891100b1765) 00000020:00000080:2.0:1787574156.085772:0:5811:0:(genops.c:1385:class_connect()) connect: client 7182851c-b624-4982-87cf-e891100b1765, cookie 0xfe91058e646bf473 00000100:00080000:2.0:1787574156.085786:0:5811:0:(import.c:510:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787574156.085791:0:5811:0:(import.c:624:import_select_connection()) MGC192.168.206.151@tcp: import 00000000c328d944 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1787574156.085834:0:5811:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002d234b7f x1874407290044544/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787574156.085863:0:5811:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7182851c-b624-4982-87cf-e891100b1765->MGS 00000020:01000004:2.0:1787574156.085884:0:5811:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787574156.085890:0:5811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787574156.085912:0:5811:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000006a83069) 00000020:00000080:2.0:1787574156.085931:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787574156.086396:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002d234b7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7182851c-b624-4982-87cf-e891100b1765:3297:1874407290044544:0@lo:250: 00000100:00100000:0.0:1787574156.086490:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574156.086580:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290044544 00000100:00100000:0.0:1787574156.086587:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290044544 00000100:00100000:0.0:1787574156.086628:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574156.086636:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab60a011 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3297:x1874407290044544:12345-0@lo:250: 00010000:00080000:0.0:1787574156.086662:0:5823:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7182851c-b624-4982-87cf-e891100b1765@0@lo t0 exp 0000000000000000 cur 132 last 0 00000020:00000080:0.0:1787574156.086685:0:5823:0:(genops.c:1385:class_connect()) connect: client 7182851c-b624-4982-87cf-e891100b1765, cookie 0xfe91058e646bf481 00000100:00080000:0.0:1787574156.086854:0:5823:0:(import.c:65:import_set_state_nolock()) 00000000ff6514ac : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574156.086903:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab60a011 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+5:3297:x1874407290044544:12345-0@lo:250: Request processed in 266us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574156.086911:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574156.086953:0:3297:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787574156.086961:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.151@tcp: connect to target with instance 0 00000100:00080000:0.0:1787574156.086968:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787574156.086972:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787574156.086975:0:3297:0:(import.c:65:import_set_state_nolock()) 00000000c328d944 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787574156.086985:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787574156.086993:0:3297:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787574156.086997:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002d234b7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7182851c-b624-4982-87cf-e891100b1765:3297:1874407290044544:0@lo:250: 00000100:00100000:2.0:1787574156.114932:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787574156.115146:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787574156.115152:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787574156.117493:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787574156.117556:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787574156.118579:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787574156.118592:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787574156.120677:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787574156.120950:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787574156.120957:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787574156.121720:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787574156.121736:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787574156.146142:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787574156.146354:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787574156.146361:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787574156.152379:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787574156.152403:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787574156.155027:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787574156.155285:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787574156.155292:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787574156.156360:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787574156.156369:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787574156.157696:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787574156.157958:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787574156.157965:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787574156.163844:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787574156.163860:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787574156.166358:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787574156.166559:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787574156.166566:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787574156.168986:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787574156.169000:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787574156.220005:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787574156.220276:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787574156.220282:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787574156.224706:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787574156.224721:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787574156.225546:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787574156.225554:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787574156.227375:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787574156.227403:0:5811:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787574156.227409:0:5811:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787574156.227545:0:5811:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787574156.227578:0:5811:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787574156.227582:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787574156.227584:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787574156.227585:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574156.227586:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574156.227587:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574156.227588:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574156.227589:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787574156.227591:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787574156.227592:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787574156.227598:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787574156.227600:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574156.227601:0:5811:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787574156.227603:0:5811:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787574156.227605:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787574156.227606:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787574156.227607:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574156.227607:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574156.227608:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574156.227609:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574156.227610:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787574156.227611:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787574156.227612:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787574156.227613:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787574156.227613:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574156.227614:0:5811:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787574156.227720:0:5811:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787574156.227738:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dea5c9dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290044672:0@lo:253: 00000100:00100000:2.0:1787574156.227932:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574156.228043:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087633b28 going to sleep for 11 seconds 00000100:00100000:0.0:1787574156.228138:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290044672 00000100:00100000:0.0:1787574156.228145:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290044672 00000100:00100000:0.0:1787574156.228352:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574156.228362:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7995adc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+5:5811:x1874407290044672:12345-0@lo:253: 20000000:01000000:0.0:1787574156.228409:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787574156.228412:0:5825:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787574156.228757:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787574156.228875:0:5825:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787574156.229195:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574156.230943:0:5847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787574156.231258:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787574156.231262:0:5825:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787574156.231268:0:5825:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787574156.231271:0:5825:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787574156.231288:0:5825:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787574156.231527:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787574156.232082:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787574156.232100:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787574156.232196:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787574156.232257:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787574156.232298:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787574156.232398:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787574156.232407:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787574156.232451:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787574156.232460:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787574156.232506:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787574156.232514:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787574156.232545:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787574156.232596:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787574156.232716:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787574156.232723:0:5825:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787574156.232737:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787574156.233076:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787574156.233088:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787574156.233124:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787574156.233160:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787574156.233364:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787574156.233379:0:5825:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787574156.233464:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787574156.233474:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787574156.233520:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787574156.233559:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787574156.233597:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787574156.233609:0:5825:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787574156.233935:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787574156.233945:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787574156.233971:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787574156.234003:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787574156.234217:0:5825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787574156.234265:0:5825:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787574156.234272:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787574156.234873:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787574156.235159:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787574156.235282:0:5825:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.151@tcp for mdt 20000000:01000000:0.0:1787574156.235285:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.151@tcp (null) (null) (null) 00000040:00080000:0.0:1787574156.235319:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787574156.235326:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787574156.235349:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787574156.235362:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.151@tcp (null) (null) 00000040:00080000:0.0:1787574156.235401:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787574156.235410:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787574156.235435:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787574156.235464:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787574156.235526:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787574156.235530:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787574156.235533:0:5825:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787574156.235545:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787574156.235547:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787574156.235572:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787574156.235574:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787574156.236163:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1787574156.236388:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787574156.236424:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1787574156.236484:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1787574156.236497:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787574156.236499:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787574156.237011:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787574156.237381:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787574156.237426:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787574156.237457:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1787574156.237470:0:5825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787574156.237473:0:5825:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1787574156.237477:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787574156.237479:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787574156.237484:0:5825:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787574156.237490:0:5825:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787574156.238019:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1787574156.238158:0:5825:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787574156.248414:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787574156.248500:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787574156.248599:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787574156.248632:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787574156.248653:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000224215e/0xfe91058e646bf488 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574156.248669:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000224215e/0xfe91058e646bf488 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574156.248679:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000224215e/0xfe91058e646bf488 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574156.248685:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000224215e/0xfe91058e646bf488 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574156.248691:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000224215e/0xfe91058e646bf488 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574156.248697:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000224215e/0xfe91058e646bf488 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574156.248702:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000224215e already unused, calling callback (00000000fa622d95) 00010000:00010000:0.0:1787574156.248706:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000224215e/0xfe91058e646bf488 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574156.248713:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000224215e/0xfe91058e646bf488 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574156.248737:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000224215e/0xfe91058e646bf488 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574156.250102:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000224215e/0xfe91058e646bf488 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574156.250113:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000224215e/0xfe91058e646bf488 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787574156.250154:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787574156.553361:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7995adc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+5:5811:x1874407290044672:12345-0@lo:253: Request processed in 324988us (325417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574156.553387:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787574156.553406:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dea5c9dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290044672:0@lo:253: 10000000:01000000:3.0:1787574156.553431:0:5811:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787574156.553435:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787574156.553437:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787574156.553438:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574156.553440:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787574156.553442:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574156.553444:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574156.553446:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787574156.553447:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787574156.553449:0:5811:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787574156.553450:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574156.553451:0:5811:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787574156.553474:0:5811:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000da8c6f1e from lustre-MDT0000 10000000:01000000:3.0:1787574156.553502:0:5811:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787574156.553505:0:5811:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787574156.553508:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff982a0488b370 10000000:01000000:3.0:1787574156.553512:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787574156.553519:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff982a0488b370 from 1 10000000:01000000:3.0:1787574156.553522:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787574156.553576:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: 0000000037413a1f/0xfe91058e646bf48f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574156.553585:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: 0000000037413a1f/0xfe91058e646bf48f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574156.553593:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: 0000000037413a1f/0xfe91058e646bf48f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574156.553610:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff346de6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290044800:0@lo:101: 00000100:00100000:3.0:1787574156.553686:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574156.553755:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000958131a2 going to sleep for 11 seconds 00000100:00100000:3.0:1787574156.553782:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290044800 00000100:00100000:3.0:1787574156.553793:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290044800 00000100:00100000:3.0:1787574156.553838:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574156.553846:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001c1a1b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+5:5811:x1874407290044800:12345-0@lo:101: 00010000:00010000:3.0:1787574156.553857:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574156.553870:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000060c80c4/0xfe91058e646bf496 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf48f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574156.553890:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000060c80c4/0xfe91058e646bf496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf48f expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574156.553898:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000060c80c4/0xfe91058e646bf496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf48f expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574156.553907:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000060c80c4, rc 0) 00000100:00100000:3.0:1787574156.553949:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001c1a1b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+6:5811:x1874407290044800:12345-0@lo:101: Request processed in 104us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574156.553956:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787574156.554012:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff346de6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290044800:0@lo:101: 00010000:00010000:2.0:1787574156.554037:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: 0000000037413a1f/0xfe91058e646bf48f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf496 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574156.554051:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: 0000000037413a1f/0xfe91058e646bf48f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf496 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574156.554231:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000165250d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290044928:0@lo:501: 00000100:00100000:2.0:1787574156.554280:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574156.554310:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000983b30fd going to sleep for 11 seconds 00000100:00100000:3.0:1787574156.554416:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290044928 00000100:00100000:3.0:1787574156.554423:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290044928 00000100:00100000:3.0:1787574156.554458:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787574156.554465:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f80b8381 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+6:5811:x1874407290044928:12345-0@lo:501: 00000100:00100000:3.0:1787574156.554698:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f80b8381 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+6:5811:x1874407290044928:12345-0@lo:501: Request processed in 234us (418us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787574156.554706:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787574156.554963:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000165250d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290044928:0@lo:501: 10000000:01000000:2.0:1787574156.555161:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787574156.555215:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: 0000000037413a1f/0xfe91058e646bf48f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf496 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574156.555226:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: 0000000037413a1f/0xfe91058e646bf48f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf496 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574156.555236:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff982a0622a800 10000000:01000000:2.0:1787574156.555242:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787574156.555248:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff982a0622a800 10000000:01000000:2.0:1787574156.555250:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787574156.555253:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff982a0622a800 from 1 10000000:01000000:2.0:1787574156.555257:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787574156.555294:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: 000000006acd45e3/0xfe91058e646bf49d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574156.555301:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: 000000006acd45e3/0xfe91058e646bf49d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574156.555311:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: 000000006acd45e3/0xfe91058e646bf49d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574156.555325:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000165250d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290045056:0@lo:101: 00000100:00100000:2.0:1787574156.555381:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574156.555481:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000983b30fd going to sleep for 11 seconds 00000100:00100000:3.0:1787574156.555694:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290045056 00000100:00100000:3.0:1787574156.555702:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290045056 00000100:00100000:3.0:1787574156.555791:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787574156.555800:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000199aa7cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+6:5811:x1874407290045056:12345-0@lo:101: 00010000:00010000:3.0:1787574156.555815:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574156.555837:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bb6edf4e/0xfe91058e646bf4a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf49d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574156.555873:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bb6edf4e/0xfe91058e646bf4a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf49d expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574156.555884:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bb6edf4e/0xfe91058e646bf4a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf49d expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574156.555892:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bb6edf4e, rc 0) 00000100:00100000:3.0:1787574156.555957:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000199aa7cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+7:5811:x1874407290045056:12345-0@lo:101: Request processed in 158us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574156.555964:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787574156.556048:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000165250d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290045056:0@lo:101: 00010000:00010000:0.0:1787574156.556074:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: 000000006acd45e3/0xfe91058e646bf49d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf4a4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574156.556081:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: 000000006acd45e3/0xfe91058e646bf49d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf4a4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574156.556105:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787574156.556119:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: 000000006acd45e3/0xfe91058e646bf49d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf4a4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574156.556126:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: 000000006acd45e3/0xfe91058e646bf49d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf4a4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574156.556132:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787574156.556137:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787574156.556143:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff982a0622a800 10000000:01000000:0.0:1787574156.556145:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787574156.556148:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787574156.556150:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787574156.556212:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: 000000000224215e/0xfe91058e646bf4ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574156.556219:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: 000000000224215e/0xfe91058e646bf4ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574156.556225:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: 000000000224215e/0xfe91058e646bf4ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574156.556245:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b7c9ffaf pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290045184:0@lo:101: 00000100:00100000:0.0:1787574156.556275:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574156.558441:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290045184 00000100:00100000:2.0:1787574156.558457:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290045184 00000100:00100000:0.0:1787574156.558468:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 000000000ba22ccc going to sleep for 11 seconds 00000100:00100000:2.0:1787574156.558508:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787574156.558519:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd31c4bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+7:5811:x1874407290045184:12345-0@lo:101: 00010000:00010000:2.0:1787574156.558537:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574156.558558:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d797fc6f/0xfe91058e646bf4b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf4ab expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574156.558703:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d797fc6f/0xfe91058e646bf4b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf4ab expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574156.558717:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d797fc6f/0xfe91058e646bf4b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf4ab expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574156.558727:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d797fc6f, rc 0) 00000100:00100000:2.0:1787574156.558997:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd31c4bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+8:5811:x1874407290045184:12345-0@lo:101: Request processed in 478us (2720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574156.559001:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b7c9ffaf pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290045184:0@lo:101: 00000100:00100000:2.0:1787574156.559009:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787574156.559026:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: 000000000224215e/0xfe91058e646bf4ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf4b2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.559040:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: 000000000224215e/0xfe91058e646bf4ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf4b2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574156.559475:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ab27c36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290045312:0@lo:501: 00000100:00100000:1.0:1787574156.559520:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574156.559589:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 0000000029341936 going to sleep for 11 seconds 00000100:00100000:3.0:1787574156.559621:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290045312 00000100:00100000:3.0:1787574156.559627:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290045312 00000100:00100000:3.0:1787574156.559667:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787574156.559675:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7bbd75c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+8:5811:x1874407290045312:12345-0@lo:501: 00000100:00100000:3.0:1787574156.560047:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7bbd75c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+9:5811:x1874407290045312:12345-0@lo:501: Request processed in 372us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574156.560066:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787574156.560267:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ab27c36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290045312:0@lo:501: 00000100:00100000:1.0:1787574156.560392:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ab27c36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290045440:0@lo:503: 00000100:00100000:1.0:1787574156.560439:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574156.560505:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 0000000029341936 going to sleep for 11 seconds 00000100:00100000:2.0:1787574156.560538:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290045440 00000100:00100000:2.0:1787574156.560544:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290045440 00000100:00100000:2.0:1787574156.560619:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787574156.560626:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c57dff5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+9:5811:x1874407290045440:12345-0@lo:503: 00000100:00100000:2.0:1787574156.560804:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c57dff5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+9:5811:x1874407290045440:12345-0@lo:503: Request processed in 178us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574156.560812:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787574156.560873:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ab27c36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290045440:0@lo:503: 00000100:00100000:2.0:1787574156.561783:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000056a2a68e pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:5853:1874407290045568:0@lo:502: 00000100:00100000:2.0:1787574156.561853:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574156.561934:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d710b38 going to sleep for 11 seconds 00000100:00100000:3.0:1787574156.562612:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290045568 00000100:00100000:3.0:1787574156.562623:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290045568 00000100:00100000:3.0:1787574156.562706:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787574156.562716:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e56b352 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+9:5853:x1874407290045568:12345-0@lo:502: 00000100:00100000:3.0:1787574156.562990:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e56b352 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+9:5853:x1874407290045568:12345-0@lo:502: Request processed in 275us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574156.562998:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787574156.563089:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000056a2a68e pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:5853:1874407290045568:0@lo:502: 00000020:01000000:1.0:1787574156.563129:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574156.563141:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574156.563143:0:5853:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787574156.563149:0:5853:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787574156.563152:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787574156.563200:0:5853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000004c5c8b42) 00000020:00000080:1.0:1787574156.563220:0:5853:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787574156.563226:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787574156.563323:0:5853:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787574156.563338:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfe91058e646bf4c0 00000020:00000080:1.0:1787574156.563597:0:5853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787574156.563602:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574156.563606:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574156.563607:0:5853:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787574156.563610:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574156.563614:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574156.563615:0:5853:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787574156.563618:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787574156.563626:0:5853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000af915bba) 00000020:00000080:1.0:1787574156.563636:0:5853:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787574156.563640:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787574156.563642:0:5853:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787574156.563644:0:5853:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787574156.563650:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787574156.563694:0:5853:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000da8c6f1e from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787574156.563707:0:5853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000e300ab94) 00000020:00000080:1.0:1787574156.563715:0:5853:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787574156.563782:0:5853:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787574156.563788:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfe91058e646bf4d5 00000020:00000080:1.0:1787574156.563910:0:5853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787574156.563917:0:5853:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787574156.563921:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xfe91058e646bf4dc 00080000:01000000:1.0:1787574156.563927:0:5853:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787574156.563930:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfe91058e646bf4e3 00080000:10000000:1.0:1787574156.564939:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1787574156.565522:0:5853:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787574156.570435:0:5853:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787574156.629301:0:5853:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787574156.629711:0:5853:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787574156.631932:0:5853:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787574156.632330:0:5853:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787574156.660018:0:5853:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000093c0ab04) 00000020:00000080:3.0:1787574156.660045:0:5853:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787574156.660138:0:5853:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787574156.660146:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfe91058e646bf4f1 00000020:00000080:2.0:1787574156.660609:0:5853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787574156.662409:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787574156.699831:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787574156.732876:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787574156.779437:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787574156.814653:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787574156.837686:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1787574156.854551:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xfe91058e646bf4f8 00000020:00000080:0.0:1787574156.855661:0:5853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787574156.855676:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574156.855683:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574156.855686:0:5853:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787574156.855689:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574156.855694:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574156.855695:0:5853:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787574156.855699:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787574156.855701:0:5853:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787574156.855703:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574156.855705:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574156.855707:0:5853:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787574156.855709:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574156.855714:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574156.855715:0:5853:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787574156.855720:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787574156.855772:0:5853:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1787574156.855855:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000990394c pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:5853:1874407290045696:0@lo:502: 00000100:00100000:0.0:1787574156.855953:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574156.856032:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c1cc2803 going to sleep for 11 seconds 00000100:00100000:2.0:1787574156.857503:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290045696 00000100:00100000:2.0:1787574156.857517:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290045696 00000100:00100000:2.0:1787574156.857580:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787574156.857590:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039eeb468 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+9:5853:x1874407290045696:12345-0@lo:502: 00000100:00100000:2.0:1787574156.858733:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039eeb468 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+9:5853:x1874407290045696:12345-0@lo:502: Request processed in 1140us (2777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574156.858745:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787574156.859031:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000990394c pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:5853:1874407290045696:0@lo:502: 00000020:01000000:0.0:1787574156.859085:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574156.859093:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574156.859114:0:5853:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1787574156.859119:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787574156.859369:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787574156.859394:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787574156.859422:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: 000000000224215e/0xfe91058e646bf4ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf4b2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.859434:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: 000000000224215e/0xfe91058e646bf4ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf4b2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574156.859443:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff982a0622a800 from 1 10000000:01000000:1.0:1787574156.859446:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787574156.859489:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: 0000000078b548a5/0xfe91058e646bf4ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.859497:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: 0000000078b548a5/0xfe91058e646bf4ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.859507:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: 0000000078b548a5/0xfe91058e646bf4ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574156.859528:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ab27c36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290045824:0@lo:101: 00000100:00100000:1.0:1787574156.859589:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574156.859627:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290045824 00000100:00100000:1.0:1787574156.859633:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000946ff510 going to sleep for 11 seconds 00000100:00100000:3.0:1787574156.859636:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290045824 00000100:00100000:3.0:1787574156.859677:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787574156.859685:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a68acbd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+9:5811:x1874407290045824:12345-0@lo:101: 00010000:00010000:3.0:1787574156.859698:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574156.859713:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000701e6206/0xfe91058e646bf506 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf4ff expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574156.859736:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000701e6206/0xfe91058e646bf506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf4ff expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574156.859746:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000701e6206/0xfe91058e646bf506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf4ff expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574156.859756:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000701e6206, rc 0) 00000100:00100000:3.0:1787574156.859802:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a68acbd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+10:5811:x1874407290045824:12345-0@lo:101: Request processed in 117us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574156.859808:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787574156.859844:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ab27c36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290045824:0@lo:101: 00010000:00010000:1.0:1787574156.859859:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: 0000000078b548a5/0xfe91058e646bf4ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf506 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.859868:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: 0000000078b548a5/0xfe91058e646bf4ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf506 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574156.860578:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ab27c36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290045952:0@lo:256: 00000100:00100000:1.0:1787574156.860625:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574156.860676:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000946ff510 going to sleep for 11 seconds 00000100:00100000:3.0:1787574156.861095:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290045952 00000100:00100000:3.0:1787574156.861204:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290045952 00000100:00100000:3.0:1787574156.861577:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787574156.861588:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004688b9db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+10:5811:x1874407290045952:12345-0@lo:256: 20000000:01000000:3.0:1787574156.861622:0:5824:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787574156.861628:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787574156.861724:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004688b9db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+10:5811:x1874407290045952:12345-0@lo:256: Request processed in 138us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574156.861732:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787574156.861761:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ab27c36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290045952:0@lo:256: 10000000:01000000:1.0:1787574156.862591:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787574156.862822:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: 0000000078b548a5/0xfe91058e646bf4ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf506 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.862836:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: 0000000078b548a5/0xfe91058e646bf4ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf506 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574156.862847:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982a0622a800 from 1 10000000:01000000:1.0:1787574156.862850:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787574156.862891:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: 0000000030ff9f86/0xfe91058e646bf50d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.862899:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: 0000000030ff9f86/0xfe91058e646bf50d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.862910:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: 0000000030ff9f86/0xfe91058e646bf50d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574156.862931:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ab27c36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290046080:0@lo:101: 00000100:00100000:1.0:1787574156.862983:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574156.863020:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000946ff510 going to sleep for 11 seconds 00000100:00100000:2.0:1787574156.864305:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290046080 00000100:00100000:2.0:1787574156.864320:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290046080 00000100:00100000:2.0:1787574156.864390:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787574156.864401:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee268cb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+10:5811:x1874407290046080:12345-0@lo:101: 00010000:00010000:2.0:1787574156.864425:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574156.864446:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006efe574b/0xfe91058e646bf514 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf50d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574156.864480:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006efe574b/0xfe91058e646bf514 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf50d expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574156.864494:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006efe574b/0xfe91058e646bf514 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf50d expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574156.864506:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006efe574b, rc 0) 00000100:00100000:2.0:1787574156.864593:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee268cb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+11:5811:x1874407290046080:12345-0@lo:101: Request processed in 194us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574156.864614:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787574156.864854:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ab27c36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290046080:0@lo:101: 00010000:00010000:1.0:1787574156.864874:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: 0000000030ff9f86/0xfe91058e646bf50d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf514 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.864885:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: 0000000030ff9f86/0xfe91058e646bf50d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf514 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574156.865102:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ab27c36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290046208:0@lo:501: 00000100:00100000:1.0:1787574156.865144:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574156.865206:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000946ff510 going to sleep for 11 seconds 00000100:00100000:3.0:1787574156.865474:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290046208 00000100:00100000:3.0:1787574156.865480:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290046208 00000100:00100000:3.0:1787574156.865519:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787574156.865527:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b0162a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+11:5811:x1874407290046208:12345-0@lo:501: 00000100:00100000:2.0:1787574156.867688:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b0162a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+11:5811:x1874407290046208:12345-0@lo:501: Request processed in 2157us (2539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574156.867701:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787574156.867742:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ab27c36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290046208:0@lo:501: 00000100:00100000:1.0:1787574156.867797:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ab27c36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290046336:0@lo:503: 00000100:00100000:1.0:1787574156.867851:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574156.867897:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290046336 00000100:00100000:1.0:1787574156.867901:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000946ff510 going to sleep for 11 seconds 00000100:00100000:2.0:1787574156.867904:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290046336 00000100:00100000:2.0:1787574156.867945:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787574156.867955:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7a6c6f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+11:5811:x1874407290046336:12345-0@lo:503: 00000040:00080000:2.0:1787574156.867999:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787574156.868069:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7a6c6f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+11:5811:x1874407290046336:12345-0@lo:503: Request processed in 116us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574156.868076:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787574156.868122:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ab27c36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290046336:0@lo:503: 00000040:00080000:2.0:1787574156.869030:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787574156.870096:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787574156.870125:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787574156.870140:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: 0000000030ff9f86/0xfe91058e646bf50d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf514 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574156.870154:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: 0000000030ff9f86/0xfe91058e646bf50d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf514 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574156.870566:0:5811:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787574156.870571:0:5811:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff982a0622a800 10000000:01000000:0.0:1787574156.870574:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff982a0622a800 10000000:01000000:0.0:1787574156.870580:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787574156.870587:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982a0622a800 from 1 10000000:01000000:0.0:1787574156.870591:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787574156.870632:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: 0000000058b74a16/0xfe91058e646bf51b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574156.870642:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: 0000000058b74a16/0xfe91058e646bf51b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574156.870653:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: 0000000058b74a16/0xfe91058e646bf51b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574156.870679:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000990394c pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290046464:0@lo:101: 00000100:00100000:0.0:1787574156.870748:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574156.870896:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 0000000004d59f24 going to sleep for 11 seconds 00000100:00100000:2.0:1787574156.870998:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290046464 00000100:00100000:2.0:1787574156.871068:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290046464 00000100:00100000:2.0:1787574156.871148:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787574156.871159:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032b4dc7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+11:5811:x1874407290046464:12345-0@lo:101: 00010000:00010000:2.0:1787574156.871197:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574156.871212:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000080e38a2e/0xfe91058e646bf522 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf51b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574156.871250:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000080e38a2e/0xfe91058e646bf522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf51b expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574156.871262:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000080e38a2e/0xfe91058e646bf522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf51b expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574156.871271:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000080e38a2e, rc 0) 00000100:00100000:2.0:1787574156.871334:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032b4dc7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+12:5811:x1874407290046464:12345-0@lo:101: Request processed in 177us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574156.871341:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787574156.871441:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000990394c pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290046464:0@lo:101: 00010000:00010000:1.0:1787574156.871458:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: 0000000058b74a16/0xfe91058e646bf51b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf522 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.871468:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: 0000000058b74a16/0xfe91058e646bf51b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf522 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574156.871526:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ab27c36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290046592:0@lo:501: 00000100:00100000:1.0:1787574156.871555:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574156.871732:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000946ff510 going to sleep for 11 seconds 00000100:00100000:0.0:1787574156.871790:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290046592 00000100:00100000:0.0:1787574156.871795:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290046592 00000100:00100000:0.0:1787574156.871817:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787574156.871831:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000842210ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:5811:x1874407290046592:12345-0@lo:501: 00000100:00100000:0.0:1787574156.872138:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000842210ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:5811:x1874407290046592:12345-0@lo:501: Request processed in 308us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574156.872146:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787574156.872266:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ab27c36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290046592:0@lo:501: 00000100:00100000:1.0:1787574156.872297:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ab27c36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290046720:0@lo:503: 00000100:00100000:1.0:1787574156.872338:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574156.872359:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000946ff510 going to sleep for 11 seconds 00000100:00100000:1.0:1787574156.872379:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290046720 00000100:00100000:1.0:1787574156.872382:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290046720 00000100:00100000:1.0:1787574156.872407:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787574156.872412:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d88875ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:5811:x1874407290046720:12345-0@lo:503: 00000100:00100000:1.0:1787574156.872748:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d88875ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:5811:x1874407290046720:12345-0@lo:503: Request processed in 335us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574156.872756:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787574156.872795:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ab27c36 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290046720:0@lo:503: 00000100:00100000:1.0:1787574156.873032:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ab27c36 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:5858:1874407290046848:0@lo:502: 00000100:00100000:1.0:1787574156.873078:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574156.873100:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290046848 00000100:00100000:1.0:1787574156.873103:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290046848 00000100:00100000:1.0:1787574156.873121:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787574156.873126:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077df1f40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:5858:x1874407290046848:12345-0@lo:502: 00000100:00100000:1.0:1787574156.873343:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077df1f40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:5858:x1874407290046848:12345-0@lo:502: Request processed in 217us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574156.873350:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787574156.873380:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set 00000000535394f1 going to sleep for 11 seconds 00000100:00100000:1.0:1787574156.873391:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ab27c36 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:5858:1874407290046848:0@lo:502: 00000020:01000004:1.0:1787574156.873443:0:5858:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787574156.873466:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000054f2fa06) 00000020:00000080:1.0:1787574156.873489:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1787574156.873566:0:5858:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000da8c6f1e from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787574156.873571:0:5858:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000da8c6f1e from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787574156.873573:0:5858:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000da8c6f1e 4 00010000:00080000:1.0:1787574156.873607:0:5858:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006966e07c@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:1.0:1787574156.880303:0:5858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1787574156.880536:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787574156.880576:0:5858:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787574156.881835:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xfe91058e646bf530 00000100:00080000:1.0:1787574156.881849:0:5858:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787574156.881855:0:5858:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006966e07c using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1787574156.881902:0:5858:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005ab27c36 x1874407290046976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787574156.881937:0:5858:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787574156.882216:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ab27c36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874407290046976:0@lo:38: 00000100:00100000:0.0:1787574156.882320:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574156.883422:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290046976 00000100:00100000:3.0:1787574156.883435:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290046976 00000100:00100000:3.0:1787574156.883492:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787574156.883502:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074d264d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1874407290046976:12345-0@lo:38: 00000100:00100000:3.0:1787574156.883605:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074d264d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1874407290046976:12345-0@lo:38: Request processed in 102us (1286us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787574156.883613:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787574156.883668:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787574156.883678:0:3297:0:(import.c:65:import_set_state_nolock()) 000000006966e07c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787574156.883683:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787574156.883687:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ab27c36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874407290046976:0@lo:38: 00000100:00100000:1.0:1787574156.888488:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f23faa75 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:5858:1874407290047104:0@lo:502: 00000100:00100000:1.0:1787574156.888582:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574156.888639:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set 000000008db03cd9 going to sleep for 11 seconds 00000100:00100000:2.0:1787574156.888694:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290047104 00000100:00100000:2.0:1787574156.888703:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290047104 00000100:00100000:2.0:1787574156.888748:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787574156.888757:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001afe9437 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:5858:x1874407290047104:12345-0@lo:502: 00000100:00100000:2.0:1787574156.889550:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001afe9437 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:5858:x1874407290047104:12345-0@lo:502: Request processed in 792us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574156.889556:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f23faa75 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:5858:1874407290047104:0@lo:502: 00000100:00100000:2.0:1787574156.889561:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000040:00080000:3.0:1787574156.889589:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787574156.889667:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787574156.889688:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787574156.889705:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: 0000000058b74a16/0xfe91058e646bf51b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf522 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.889722:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: 0000000058b74a16/0xfe91058e646bf51b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf522 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787574156.889772:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787574156.889775:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787574156.889776:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787574156.889777:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787574156.889778:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787574156.889780:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787574156.889781:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787574156.889783:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787574156.889784:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787574156.889786:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787574156.889787:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787574156.889789:0:5811:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787574156.889792:0:5811:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787574156.889795:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787574156.889796:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787574156.889802:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787574156.889803:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787574156.889803:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787574156.889804:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787574156.889805:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787574156.889806:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787574156.889807:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787574156.889807:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787574156.889808:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787574156.889809:0:5811:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787574156.889829:0:5811:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787574156.889842:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0334091 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290047232:0@lo:253: 00000100:00100000:1.0:1787574156.889897:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574156.889929:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 0000000098c961ff going to sleep for 11 seconds 00000100:00100000:3.0:1787574156.889965:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290047232 00000100:00100000:3.0:1787574156.889972:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290047232 00000100:00100000:3.0:1787574156.890009:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787574156.890025:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c23e9397 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+12:5811:x1874407290047232:12345-0@lo:253: 20000000:01000000:3.0:1787574156.890070:0:5823:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787574156.890087:0:5823:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787574156.921032:0:5823:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787574156.921091:0:5823:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787574156.921819:0:5846:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787574156.921835:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787574156.921863:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d683d7da/0xfe91058e646bf537 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574156.921887:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000701e6206/0xfe91058e646bf506 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf4ff expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574156.921896:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d683d7da/0xfe91058e646bf537 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574156.921957:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000701e6206/0xfe91058e646bf506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf4ff expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574156.921975:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000701e6206/0xfe91058e646bf506 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf4ff expref: 12 pid: 5825 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574156.921992:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000645ebf0c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1874407290047360:0@lo:104: 00000100:00100000:0.0:1787574156.922083:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574156.922151:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 000000000198ae80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574156.922280:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290047360 00000100:00100000:1.0:1787574156.922290:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290047360 00000100:00100000:1.0:1787574156.922348:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787574156.922358:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000060ba19 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7182851c-b624-4982-87cf-e891100b1765+3:5846:x1874407290047360:12345-0@lo:104: 00010000:00010000:1.0:1787574156.922372:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: 0000000078b548a5/0xfe91058e646bf4ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf506 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.922443:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787574156.922448:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000060ba19 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7182851c-b624-4982-87cf-e891100b1765+3:5846:x1874407290047360:12345-0@lo:104: Request processed in 93us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574156.922455:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787574156.922477:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574156.922482:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: 0000000078b548a5/0xfe91058e646bf4ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf506 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.922489:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000078b548a5 already unused, calling callback (0000000001fb9281) 10000000:00010000:1.0:1787574156.922492:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: 0000000078b548a5/0xfe91058e646bf4ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf506 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.922516:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: 0000000078b548a5/0xfe91058e646bf4ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf506 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574156.922523:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: 0000000078b548a5/0xfe91058e646bf4ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf506 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574156.922528:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574156.922559:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: 0000000078b548a5/0xfe91058e646bf4ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf506 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.922565:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574156.922585:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: 0000000078b548a5/0xfe91058e646bf4ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf506 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.922591:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: 0000000078b548a5/0xfe91058e646bf4ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf506 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.922607:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574156.922609:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574156.922610:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574156.922678:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000543f2b2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290047488:0@lo:103: 00000100:00100000:1.0:1787574156.922711:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574156.922885:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290047488 00000100:00100000:1.0:1787574156.922890:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290047488 00010000:00010000:1.0:1787574156.922909:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000701e6206/0xfe91058e646bf506 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf4ff expref: 13 pid: 5825 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574156.922934:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787574156.922940:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffc74610 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+13:3299:x1874407290047488:12345-0@lo:103: 00010000:00010000:1.0:1787574156.922957:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574156.922963:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000701e6206/0xfe91058e646bf506 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf4ff expref: 13 pid: 5825 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.922973:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000701e6206/0xfe91058e646bf506 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf4ff expref: 13 pid: 5825 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.922991:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d683d7da/0xfe91058e646bf537 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.922999:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d683d7da/0xfe91058e646bf537 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787574156.923012:0:5815:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001178774s 00010000:00010000:1.0:1787574156.923016:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d683d7da/0xfe91058e646bf537 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.923023:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d683d7da/0xfe91058e646bf537 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.923029:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d683d7da/0xfe91058e646bf537 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.923035:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d683d7da/0xfe91058e646bf537 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.923040:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d683d7da already unused, calling callback (00000000fa622d95) 00010000:00010000:1.0:1787574156.923044:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d683d7da/0xfe91058e646bf537 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.923059:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d683d7da/0xfe91058e646bf537 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.923074:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d683d7da/0xfe91058e646bf537 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574156.923084:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574156.923113:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffc74610 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+13:3299:x1874407290047488:12345-0@lo:103: Request processed in 174us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574156.923121:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787574156.923159:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000543f2b2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290047488:0@lo:103: 00010000:00010000:2.0:1787574156.923268:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000701e6206/0xfe91058e646bf506 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf4ff expref: 12 pid: 5825 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574156.923280:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000645ebf0c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1874407290047360:0@lo:104: 00010000:00010000:2.0:1787574156.923294:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d683d7da/0xfe91058e646bf537 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574156.923303:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d683d7da/0xfe91058e646bf537 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574156.923308:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d683d7da/0xfe91058e646bf537 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574156.923313:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d683d7da/0xfe91058e646bf537 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574156.933143:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c23e9397 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+11:5811:x1874407290047232:12345-0@lo:253: Request processed in 43117us (43236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574156.933160:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787574156.933452:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0334091 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:5811:1874407290047232:0@lo:253: 10000000:01000000:1.0:1787574156.933474:0:5811:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787574156.933477:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787574156.933479:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787574156.933481:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787574156.933482:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787574156.933483:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787574156.933484:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787574156.933486:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787574156.933487:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787574156.933489:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787574156.933490:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787574156.933492:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787574156.933493:0:5811:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787574156.933510:0:5811:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787574156.944858:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787574156.947963:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787574156.948626:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787574156.948795:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787574156.949499:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787574156.949742:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787574156.958552:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787574156.958763:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787574156.958963:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787574156.959202:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787574156.959413:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787574156.959583:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1787574157.004518:0:5811:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787574157.031211:0:5811:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787574157.031489:0:5865:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787574157.034813:0:5811:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787574157.035030:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1787574157.035412:0:5864:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1787574157.035418:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00000080:2.0:1787574157.039468:0:5811:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787574157.039561:0:5811:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787574157.040540:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:0.0:1787574157.044026:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787574157.044876:0:5811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787574157.045837:0:5811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787574157.045873:0:5811:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787574157.046840:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787574157.047305:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1787574157.049913:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787574157.050131:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787574157.050288:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787574157.050407:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787574157.050531:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787574157.051241:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787574157.051410:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787574157.051653:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787574157.051797:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787574157.052060:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787574157.052435:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787574157.052832:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787574157.053060:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787574157.053379:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787574157.053546:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787574157.053792:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787574157.054328:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787574157.054498:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787574157.054733:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787574157.054886:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787574157.055290:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787574157.055458:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787574157.055646:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787574157.055802:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787574157.055920:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787574157.059344:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787574157.059865:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787574157.060090:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787574157.060725:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787574157.060878:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787574157.061117:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787574157.061510:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787574157.061807:0:5811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1787574157.069631:0:5865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787574157.119981:0:5811:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787574157.120043:0:5811:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb5e241df3988 00100000:10000000:2.0:1787574157.120066:0:5811:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787574157.122807:0:5811:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787574157.122825:0:5811:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787574157.122841:0:5811:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787574157.122867:0:5811:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1787574157.199775:0:5865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787574157.199867:0:5865:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787574157.199872:0:5865:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1787574158.067284:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574159.092236:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574160.116417:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787574161.113081:0:6107:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787574161.139045:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787574162.033999:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787574162.034012:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787574162.034015:0:467:0:(import.c:65:import_set_state_nolock()) 000000006966e07c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787574162.034040:0:467:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006966e07c using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1787574162.034070:0:467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000543f2b2a x1874407290047744/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787574162.034133:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787574162.034156:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0334091 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290047616:0@lo:400: 00000100:00100000:0.0:1787574162.034285:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574162.034361:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000543f2b2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874407290047744:0@lo:38: 00000100:00100000:0.0:1787574162.034383:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290047616 00000100:00100000:0.0:1787574162.034395:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290047616 00000100:00100000:3.0:1787574162.034438:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574162.034463:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787574162.034474:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b850b5da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+11:3301:x1874407290047616:12345-0@lo:400: 00000100:00100000:0.0:1787574162.034536:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b850b5da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+11:3301:x1874407290047616:12345-0@lo:400: Request processed in 65us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574162.034543:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787574162.034618:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0334091 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290047616:0@lo:400: 00000100:00100000:1.0:1787574162.034923:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290047744 00000100:00100000:1.0:1787574162.034933:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290047744 00000100:00100000:1.0:1787574162.034971:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787574162.034978:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c19883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1874407290047744:12345-0@lo:38: 00010000:00080000:1.0:1787574162.035010:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 138 last 0 00000020:00000080:1.0:1787574162.035065:0:5832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xfe91058e646bf53e 00000004:00100000:1.0:1787574162.035122:0:5832:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787574162.035309:0:5832:0:(import.c:65:import_set_state_nolock()) 00000000c3fda301 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787574162.035417:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c19883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874407290047744:12345-0@lo:38: Request processed in 439us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574162.035426:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787574162.035767:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000543f2b2a x1874407290047744/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787574162.035788:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787574162.035797:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787574162.035803:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787574162.035805:0:3297:0:(import.c:65:import_set_state_nolock()) 000000006966e07c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787574162.035811:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000543f2b2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874407290047744:0@lo:38: 00010000:00010000:2.0:1787574162.166279:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787574163.057384:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787574163.057396:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff982a0622a800 from 3 10000000:01000000:0.0:1787574163.057404:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787574163.057466:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: 000000008f9d5744/0xfe91058e646bf545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574163.057506:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: 000000008f9d5744/0xfe91058e646bf545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574163.057520:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: 000000008f9d5744/0xfe91058e646bf545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574163.057551:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f2f21b8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290047872:0@lo:101: 00000100:00100000:0.0:1787574163.057634:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574163.057712:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000007bd5baf going to sleep for 11 seconds 00000100:00100000:3.0:1787574163.057835:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290047872 00000100:00100000:3.0:1787574163.057845:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290047872 00000100:00100000:3.0:1787574163.057914:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787574163.057933:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a723e32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+11:5827:x1874407290047872:12345-0@lo:101: 00010000:00010000:3.0:1787574163.057951:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574163.057967:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000701e6206/0xfe91058e646bf54c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf545 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574163.058013:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000701e6206/0xfe91058e646bf54c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf545 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574163.058033:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000701e6206/0xfe91058e646bf54c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf545 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574163.058043:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000701e6206, rc 0) 00000100:00100000:3.0:1787574163.058098:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a723e32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+12:5827:x1874407290047872:12345-0@lo:101: Request processed in 175us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574163.058105:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787574163.059592:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f2f21b8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290047872:0@lo:101: 00010000:00010000:1.0:1787574163.059619:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: 000000008f9d5744/0xfe91058e646bf545 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf54c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574163.059632:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: 000000008f9d5744/0xfe91058e646bf545 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf54c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574163.059724:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008de64e51 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290048000:0@lo:256: 00000100:00100000:1.0:1787574163.059781:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574163.059827:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 000000001ec328fe going to sleep for 11 seconds 00000100:00100000:0.0:1787574163.060113:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290048000 00000100:00100000:0.0:1787574163.060121:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290048000 00000100:00100000:0.0:1787574163.060219:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787574163.060229:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046ab9481 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:5827:x1874407290048000:12345-0@lo:256: 20000000:01000000:0.0:1787574163.060253:0:5825:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787574163.060271:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787574163.060274:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787574163.060373:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046ab9481 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:5827:x1874407290048000:12345-0@lo:256: Request processed in 146us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574163.060381:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787574163.062931:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008de64e51 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290048000:0@lo:256: 10000000:01000000:1.0:1787574163.063013:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787574163.063036:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: 000000008f9d5744/0xfe91058e646bf545 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf54c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574163.063048:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: 000000008f9d5744/0xfe91058e646bf545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf54c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574163.185430:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574164.210248:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574165.234731:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787574165.507681:0:6310:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe06866f60 20000000:00000080:3.0:1787574165.507698:0:6310:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff982a3a544800 uarg=0000000000000000 20000000:01000000:3.0:1787574165.507732:0:6310:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787574165.507740:0:6310:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787574165.507745:0:6310:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787574165.508061:0:6310:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787574165.508078:0:6310:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787574165.515056:0:6310:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787574165.515653:0:6310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787574165.515726:0:6310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787574165.515779:0:6310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787574165.515798:0:6310:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787574165.515816:0:6310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000017f1c647/0xfe91058e646bf553 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574165.515834:0:6310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006efe574b/0xfe91058e646bf514 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf50d expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574165.515842:0:6310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000017f1c647/0xfe91058e646bf553 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574165.515892:0:6310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006efe574b/0xfe91058e646bf514 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf50d expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574165.515906:0:6310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006efe574b/0xfe91058e646bf514 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf50d expref: 11 pid: 5823 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574165.515921:0:6310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000d021f9b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6310:1874407290048128:0@lo:104: 00000100:00100000:3.0:1787574165.516286:0:6310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574165.516331:0:6310:0:(client.c:2715:ptlrpc_set_wait()) set 000000000695389e going to sleep for 11 seconds 00000100:00100000:0.0:1787574165.516413:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290048128 00000100:00100000:0.0:1787574165.516421:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290048128 00000100:00100000:0.0:1787574165.516472:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574165.516490:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063119662 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+3:6310:x1874407290048128:12345-0@lo:104: 00010000:00010000:0.0:1787574165.516502:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: 0000000030ff9f86/0xfe91058e646bf50d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf514 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574165.516587:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787574165.516593:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063119662 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+3:6310:x1874407290048128:12345-0@lo:104: Request processed in 105us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574165.516600:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787574165.516621:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574165.516626:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: 0000000030ff9f86/0xfe91058e646bf50d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf514 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574165.516633:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000030ff9f86 already unused, calling callback (0000000001fb9281) 10000000:00010000:0.0:1787574165.516636:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: 0000000030ff9f86/0xfe91058e646bf50d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf514 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574165.516644:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: 0000000030ff9f86/0xfe91058e646bf50d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf514 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574165.516650:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: 0000000030ff9f86/0xfe91058e646bf50d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf514 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574165.516656:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787574165.516682:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: 0000000030ff9f86/0xfe91058e646bf50d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf514 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574165.516689:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574165.516705:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: 0000000030ff9f86/0xfe91058e646bf50d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf514 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574165.516711:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: 0000000030ff9f86/0xfe91058e646bf50d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf514 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574165.516737:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574165.516738:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574165.516740:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574165.516758:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004fab630c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290048256:0@lo:103: 00000100:00100000:0.0:1787574165.516786:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574165.516834:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290048256 00000100:00100000:0.0:1787574165.516838:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290048256 00010000:00010000:0.0:1787574165.516857:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006efe574b/0xfe91058e646bf514 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf50d expref: 12 pid: 5823 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574165.516884:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574165.516891:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4a698e2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+12:3301:x1874407290048256:12345-0@lo:103: 00010000:00010000:0.0:1787574165.516903:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574165.516908:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006efe574b/0xfe91058e646bf514 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf50d expref: 12 pid: 5823 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574165.516918:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006efe574b/0xfe91058e646bf514 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf50d expref: 12 pid: 5823 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574165.516934:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000017f1c647/0xfe91058e646bf553 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574165.516942:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000017f1c647/0xfe91058e646bf553 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574165.516956:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000017f1c647/0xfe91058e646bf553 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574165.517187:0:6310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006efe574b/0xfe91058e646bf514 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf50d expref: 12 pid: 5823 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574165.517200:0:6310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000d021f9b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6310:1874407290048128:0@lo:104: 00010000:00010000:1.0:1787574165.517216:0:6310:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000017f1c647/0xfe91058e646bf553 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574165.517223:0:6310:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: 0000000017f1c647/0xfe91058e646bf553 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574165.517228:0:6310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000017f1c647/0xfe91058e646bf553 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574165.518363:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000017f1c647/0xfe91058e646bf553 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574165.518381:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000017f1c647/0xfe91058e646bf553 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574165.518387:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000017f1c647/0xfe91058e646bf553 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574165.518393:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000017f1c647 already unused, calling callback (00000000fa622d95) 00010000:00010000:0.0:1787574165.518395:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000017f1c647/0xfe91058e646bf553 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574165.518404:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000017f1c647/0xfe91058e646bf553 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574165.518415:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000017f1c647/0xfe91058e646bf553 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574165.518423:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000017f1c647/0xfe91058e646bf553 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574165.518440:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574165.518653:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4a698e2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+11:3301:x1874407290048256:12345-0@lo:103: Request processed in 1761us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574165.518662:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787574165.518854:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004fab630c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290048256:0@lo:103: 00010000:00010000:0.0:1787574166.265051:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574167.153815:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037a9159c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290048512:0@lo:400: 00000100:00100000:1.0:1787574167.153902:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574167.153973:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787574167.153986:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000079bfa9ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290048384:0@lo:400: 00000100:00100000:1.0:1787574167.154029:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574167.154064:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290048384 00000100:00100000:1.0:1787574167.154072:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290048384 00000100:00100000:1.0:1787574167.154123:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787574167.154133:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035707cb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+11:3299:x1874407290048384:12345-0@lo:400: 00000100:00100000:0.0:1787574167.154815:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290048512 00000100:00100000:0.0:1787574167.154821:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290048512 00000100:00100000:0.0:1787574167.154860:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574167.154867:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008de64e51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290048512:12345-0@lo:400: 00000100:00100000:0.0:1787574167.154914:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008de64e51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290048512:12345-0@lo:400: Request processed in 48us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574167.154927:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574167.155008:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000079bfa9ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290048384:0@lo:400: 00010000:00080000:0.0:1787574167.155043:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000037a9159c x1874407290048512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574167.155057:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037a9159c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290048512:0@lo:400: 00000100:00100000:1.0:1787574167.155907:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035707cb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+11:3299:x1874407290048384:12345-0@lo:400: Request processed in 83us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574167.155920:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787574167.283598:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574168.312798:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787574168.883621:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787574168.883629:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982a0622a800 from 1 10000000:01000000:1.0:1787574168.883635:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787574168.883690:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: 00000000e90dbac5/0xfe91058e646bf55a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574168.883703:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: 00000000e90dbac5/0xfe91058e646bf55a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574168.883714:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: 00000000e90dbac5/0xfe91058e646bf55a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574168.883739:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cda58cee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290048640:0@lo:101: 00000100:00100000:1.0:1787574168.883811:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574168.883872:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000024df54b4 going to sleep for 11 seconds 00000100:00100000:0.0:1787574168.889293:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290048640 00000100:00100000:0.0:1787574168.889307:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290048640 00000100:00100000:0.0:1787574168.889364:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787574168.889372:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002df5e216 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+11:5827:x1874407290048640:12345-0@lo:101: 00010000:00010000:0.0:1787574168.889391:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574168.889409:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000081d6a286/0xfe91058e646bf561 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf55a expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574168.889435:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000081d6a286/0xfe91058e646bf561 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf55a expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574168.889445:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000081d6a286/0xfe91058e646bf561 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf55a expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574168.889454:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000081d6a286, rc 0) 00000100:00100000:0.0:1787574168.889538:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002df5e216 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+12:5827:x1874407290048640:12345-0@lo:101: Request processed in 167us (5728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574168.889545:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787574168.889741:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cda58cee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290048640:0@lo:101: 00010000:00010000:1.0:1787574168.889757:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: 00000000e90dbac5/0xfe91058e646bf55a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf561 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574168.889765:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: 00000000e90dbac5/0xfe91058e646bf55a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf561 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574168.889835:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cda58cee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290048768:0@lo:501: 00000100:00100000:1.0:1787574168.889870:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574168.889898:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000024df54b4 going to sleep for 11 seconds 00000100:00100000:1.0:1787574168.889912:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290048768 00000100:00100000:1.0:1787574168.889915:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290048768 00000100:00100000:1.0:1787574168.889939:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787574168.889945:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097daab33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+12:5827:x1874407290048768:12345-0@lo:501: 00000100:00100000:1.0:1787574168.890214:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097daab33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+12:5827:x1874407290048768:12345-0@lo:501: Request processed in 268us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574168.890221:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787574168.890251:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cda58cee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290048768:0@lo:501: 00000100:00100000:1.0:1787574168.890273:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cda58cee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290048896:0@lo:503: 00000100:00100000:1.0:1787574168.890308:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574168.890374:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290048896 00000100:00100000:0.0:1787574168.890379:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290048896 00000100:00100000:0.0:1787574168.890411:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787574168.890417:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000227f9fcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:5827:x1874407290048896:12345-0@lo:503: 00000100:00100000:0.0:1787574168.890547:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000227f9fcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:5827:x1874407290048896:12345-0@lo:503: Request processed in 131us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574168.890554:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787574168.892161:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000024df54b4 going to sleep for 11 seconds 00000100:00100000:1.0:1787574168.892216:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cda58cee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290048896:0@lo:503: 00000100:00100000:2.0:1787574168.892624:0:6546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c8d18cea pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:6546:1874407290049024:0@lo:502: 00000100:00100000:2.0:1787574168.892776:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574168.892813:0:6546:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d4ac4569 going to sleep for 11 seconds 00000100:00100000:1.0:1787574168.892862:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290049024 00000100:00100000:1.0:1787574168.892867:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290049024 00000100:00100000:1.0:1787574168.892900:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787574168.892908:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000965c45ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:6546:x1874407290049024:12345-0@lo:502: 00000100:00100000:1.0:1787574168.893126:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000965c45ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:6546:x1874407290049024:12345-0@lo:502: Request processed in 219us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574168.893134:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787574168.893263:0:6546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c8d18cea pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:6546:1874407290049024:0@lo:502: 00000020:01000000:2.0:1787574168.893290:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574168.893301:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574168.893303:0:6546:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787574168.893311:0:6546:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982a0622a800 00000020:00000080:2.0:1787574168.893318:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787574168.893451:0:6546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:6546:1874407290049152:0@lo:502: 00000100:00100000:2.0:1787574168.893486:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574168.893551:0:6546:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a03d5c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574168.898975:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290049152 00000100:00100000:1.0:1787574168.899001:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290049152 00000100:00100000:1.0:1787574168.899139:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787574168.899149:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:6546:x1874407290049152:12345-0@lo:502: 00000100:00100000:1.0:1787574168.900908:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:6546:x1874407290049152:12345-0@lo:502: Request processed in 1753us (7413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574168.900921:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787574168.901493:0:6546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:6546:1874407290049152:0@lo:502: 00000020:01000000:2.0:1787574168.901529:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574168.901538:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574168.901540:0:6546:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787574168.901545:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787574168.902782:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787574168.902808:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787574168.902819:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf55a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf561 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574168.902831:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf55a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf561 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574169.329519:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574170.353650:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574171.378120:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787574171.878672:0:6679:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787574171.878677:0:6679:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787574171.878838:0:6679:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff982a41658000 00000020:01000004:2.0:1787574171.878867:0:6679:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787574171.878881:0:6679:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787574171.878983:0:6679:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff982a035619b8) 00000020:00000080:2.0:1787574171.879002:0:6679:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787574171.924233:0:6679:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787574171.926131:0:6679:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1787574171.985506:0:6679:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787574171.993310:0:6679:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787574171.993351:0:6679:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787574171.993416:0:6679:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787574171.993443:0:6679:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787574171.994278:0:6679:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787574171.994292:0:6679:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787574171.994303:0:6679:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xfe91058e646bf56f 00000020:01000004:1.0:1787574171.994313:0:6679:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1787574171.994337:0:6679:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787574171.994341:0:6679:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787574171.994347:0:6679:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787574171.994351:0:6679:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787574171.994365:0:6679:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff982a03e93370) 00000020:00000080:1.0:1787574171.994374:0:6679:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1787574171.998488:0:6679:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787574171.998741:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787574171.998749:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787574171.999627:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787574171.999644:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787574172.000144:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787574172.000151:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787574172.003115:0:6679:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787574172.003608:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787574172.003616:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787574172.005842:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787574172.005864:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787574172.034729:0:6679:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574172.035157:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787574172.035187:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787574172.041485:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787574172.041570:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787574172.042781:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787574172.042803:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787574172.047002:0:6679:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574172.047821:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787574172.047832:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787574172.048652:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787574172.048662:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787574172.171538:0:6679:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787574172.171797:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787574172.171805:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787574172.173235:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787574172.173249:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787574172.173904:0:6679:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787574172.173946:0:6679:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787574172.173953:0:6679:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787574172.239712:0:6679:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787574172.239758:0:6679:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1787574172.239834:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787574172.239835:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787574172.239837:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787574172.239838:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787574172.239840:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787574172.239841:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787574172.239842:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787574172.239844:0:6679:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787574172.239845:0:6679:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787574172.239847:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787574172.239848:0:6679:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787574172.239852:0:6679:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1787574172.239854:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787574172.239856:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787574172.239857:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787574172.239858:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787574172.239859:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787574172.239860:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787574172.239861:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787574172.239862:0:6679:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787574172.239863:0:6679:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787574172.239864:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787574172.239865:0:6679:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787574172.239899:0:6679:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787574172.240411:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290049280:0@lo:253: 00000100:00100000:0.0:1787574172.240509:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574172.240649:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0805f000 going to sleep for 11 seconds 00000100:00100000:1.0:1787574172.240835:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290049280 00000100:00100000:1.0:1787574172.240845:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290049280 00000100:00100000:1.0:1787574172.240951:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787574172.240963:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04966450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:6679:x1874407290049280:12345-0@lo:253: 20000000:01000000:1.0:1787574172.241014:0:5825:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787574172.241019:0:5825:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787574172.241025:0:5825:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787574172.241030:0:5825:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787574172.242106:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574172.242371:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787574172.242388:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787574172.242433:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787574172.242441:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787574172.242489:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787574172.242545:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787574172.242944:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787574172.242966:0:5825:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.151@tcp 20000000:01000000:1.0:1787574172.243094:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.151@tcp (null) (null) (null) 00000040:00080000:1.0:1787574172.243129:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787574172.243137:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787574172.243211:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787574172.243220:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.151@tcp (null) (null) 00000040:00080000:1.0:1787574172.243249:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787574172.243257:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787574172.243281:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787574172.243338:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1787574172.246922:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787574172.246961:0:5825:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.151@tcp 20000000:01000000:1.0:1787574172.246964:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.151@tcp (null) (null) (null) 00000040:00080000:1.0:1787574172.247012:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787574172.247021:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787574172.247211:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787574172.247221:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.151@tcp (null) (null) 00000040:00080000:1.0:1787574172.247275:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787574172.247286:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787574172.247317:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1787574172.247589:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1787574172.247609:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787574172.247612:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787574172.247617:0:5825:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787574172.247631:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787574172.247846:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787574172.247890:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787574172.247894:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787574172.251285:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1787574172.251400:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1787574172.251467:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787574172.251896:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787574172.252476:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787574172.252558:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1787574172.252578:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787574172.252581:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787574172.253513:0:6695:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1787574172.253580:0:6695:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1787574172.253631:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1787574172.256067:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1787574172.256126:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1787574172.256160:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1787574172.256618:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787574172.256622:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787574172.258679:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1787574172.259296:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1787574172.259353:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1787574172.259431:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1787574172.259452:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1787574172.259455:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1787574172.259465:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787574172.259493:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982a027f2400/0xfe91058e646bf57d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.259514:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a027f3600/0xfe91058e646bf496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf48f expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.259522:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a1d2aba00/0xfe91058e646bf4b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf4ab expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.259528:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf522 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf51b expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.259535:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982a027f2400/0xfe91058e646bf57d lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.259583:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf51b expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.259601:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf522 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf51b expref: 12 pid: 5824 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574172.259617:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1874407290049408:0@lo:104: 00000100:00100000:3.0:1787574172.259704:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787574172.259790:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a1d2aba00/0xfe91058e646bf4b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf4ab expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.259798:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a1d2aba00/0xfe91058e646bf4b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf4ab expref: 12 pid: 5823 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574172.259806:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1874407290049536:0@lo:104: 00000100:00100000:3.0:1787574172.259829:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787574172.259860:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a027f3600/0xfe91058e646bf496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf48f expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.259868:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a027f3600/0xfe91058e646bf496 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf48f expref: 12 pid: 5824 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574172.259876:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1874407290049664:0@lo:104: 00000100:00100000:3.0:1787574172.259896:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574172.259907:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a2bc68300 going to sleep for 11 seconds 00000100:00100000:1.0:1787574172.260016:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290049408 00000100:00100000:1.0:1787574172.260026:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290049408 00000100:00100000:1.0:1787574172.260082:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290049536 00000100:00100000:1.0:1787574172.260085:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290049536 00000100:00100000:1.0:1787574172.260097:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290049664 00000100:00100000:1.0:1787574172.260099:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290049664 00000100:00100000:1.0:1787574172.260113:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787574172.260123:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7182851c-b624-4982-87cf-e891100b1765+5:5825:x1874407290049408:12345-0@lo:104: 00010000:00010000:1.0:1787574172.260145:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf51b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf522 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.260236:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787574172.260243:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7182851c-b624-4982-87cf-e891100b1765+5:5825:x1874407290049408:12345-0@lo:104: Request processed in 121us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574172.260251:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787574172.260272:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787574172.260279:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7182851c-b624-4982-87cf-e891100b1765+4:5825:x1874407290049536:12345-0@lo:104: 00010000:00010000:1.0:1787574172.260286:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf4ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf4b2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.260322:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787574172.260328:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7182851c-b624-4982-87cf-e891100b1765+4:5825:x1874407290049536:12345-0@lo:104: Request processed in 50us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574172.260333:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787574172.260345:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787574172.260351:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7182851c-b624-4982-87cf-e891100b1765+3:5825:x1874407290049664:12345-0@lo:104: 00010000:00010000:1.0:1787574172.260373:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a027f3400/0xfe91058e646bf48f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf496 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.260398:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787574172.260403:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7182851c-b624-4982-87cf-e891100b1765+3:5825:x1874407290049664:12345-0@lo:104: Request processed in 53us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574172.260408:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787574172.260425:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787574172.260430:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf51b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf522 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.260445:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00031400 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:1.0:1787574172.260449:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf51b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf522 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.260456:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf51b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf522 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574172.260463:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf51b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf522 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574172.260467:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574172.260498:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf51b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf522 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.260504:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574172.260525:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf51b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf522 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.260531:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf51b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf522 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.260546:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787574172.260550:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf4ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf4b2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.260556:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030a00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:1.0:1787574172.260559:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf4ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf4b2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.260574:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf4ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf4b2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574172.260580:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf4ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf4b2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574172.260584:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574172.260597:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf4ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf4b2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.260602:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574172.260607:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf4ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf4b2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.260612:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf4ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf4b2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.260621:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574172.260623:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a027f3400/0xfe91058e646bf48f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf496 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.260628:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a027f3400 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:1.0:1787574172.260630:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a027f3400/0xfe91058e646bf48f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf496 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.260635:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a027f3400/0xfe91058e646bf48f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf496 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574172.260640:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a027f3400/0xfe91058e646bf48f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf496 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574172.260650:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574172.260661:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a027f3400/0xfe91058e646bf48f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf496 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.260666:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574172.260680:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a027f3400/0xfe91058e646bf48f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf496 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.260687:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a027f3400/0xfe91058e646bf48f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf496 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.260701:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574172.260703:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574172.260704:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574172.260728:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290049792:0@lo:103: 00000100:00100000:1.0:1787574172.260760:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574172.260794:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574172.260801:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290049920:0@lo:103: 00000100:00100000:1.0:1787574172.260821:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574172.260847:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290050048:0@lo:103: 00000100:00100000:1.0:1787574172.260868:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574172.260897:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290049792 00000100:00100000:1.0:1787574172.260901:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290049792 00010000:00010000:1.0:1787574172.260920:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf522 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf51b expref: 13 pid: 5824 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574172.260935:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290049920 00000100:00100000:1.0:1787574172.260937:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290049920 00010000:00010000:1.0:1787574172.260955:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a1d2aba00/0xfe91058e646bf4b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf4ab expref: 14 pid: 5823 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574172.260965:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290050048 00000100:00100000:1.0:1787574172.260978:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290050048 00010000:00010000:1.0:1787574172.260988:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a027f3600/0xfe91058e646bf496 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf48f expref: 15 pid: 5824 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574172.260998:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787574172.261004:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+15:3300:x1874407290049792:12345-0@lo:103: 00010000:00010000:1.0:1787574172.261015:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574172.261020:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf522 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf51b expref: 15 pid: 5824 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.261031:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf522 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf51b expref: 15 pid: 5824 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.261047:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574172.261072:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+15:3300:x1874407290049792:12345-0@lo:103: Request processed in 68us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574172.261078:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787574172.261089:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787574172.261094:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+14:3300:x1874407290049920:12345-0@lo:103: 00010000:00010000:1.0:1787574172.261100:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574172.261104:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a1d2aba00/0xfe91058e646bf4b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf4ab expref: 14 pid: 5823 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.261111:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a1d2aba00/0xfe91058e646bf4b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf4ab expref: 14 pid: 5823 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.261129:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574172.261149:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+14:3300:x1874407290049920:12345-0@lo:103: Request processed in 55us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574172.261155:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787574172.261191:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787574172.261198:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+13:3298:x1874407290050048:12345-0@lo:103: 00010000:00010000:1.0:1787574172.261204:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574172.261208:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a027f3600/0xfe91058e646bf496 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf48f expref: 13 pid: 5824 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.261215:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a027f3600/0xfe91058e646bf496 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf48f expref: 13 pid: 5824 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.261227:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982a027f2400/0xfe91058e646bf57d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.261234:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a027f2400/0xfe91058e646bf57d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.261247:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a027f2400/0xfe91058e646bf57d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.261254:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a027f2400/0xfe91058e646bf57d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.261260:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982a027f2400/0xfe91058e646bf57d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.261266:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982a027f2400/0xfe91058e646bf57d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.261276:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a027f2400 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574172.261281:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982a027f2400/0xfe91058e646bf57d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.261288:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982a027f2400/0xfe91058e646bf57d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.261296:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982a027f2400/0xfe91058e646bf57d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.261306:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574172.261331:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+13:3298:x1874407290050048:12345-0@lo:103: Request processed in 134us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574172.261337:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787574172.261375:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290050048:0@lo:103: 00000100:00100000:1.0:1787574172.261395:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290049920:0@lo:103: 00000100:00100000:1.0:1787574172.261401:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290049792:0@lo:103: 00010000:00010000:2.0:1787574172.261993:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574172.262805:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf522 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf51b expref: 12 pid: 5824 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574172.262822:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1874407290049408:0@lo:104: 00010000:00010000:3.0:1787574172.262834:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a1d2aba00/0xfe91058e646bf4b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf4ab expref: 11 pid: 5823 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574172.262841:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1874407290049536:0@lo:104: 00010000:00010000:3.0:1787574172.262851:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a027f3600/0xfe91058e646bf496 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf48f expref: 10 pid: 5824 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574172.262860:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1874407290049664:0@lo:104: 00010000:00010000:3.0:1787574172.262884:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982a027f2400/0xfe91058e646bf57d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.262892:0:5825:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982a027f2400/0xfe91058e646bf57d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.262897:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982a027f2400/0xfe91058e646bf57d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.263021:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a027f2400/0xfe91058e646bf57d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787574172.263146:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787574172.280629:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290050176:0@lo:400: 00000100:00100000:0.0:1787574172.280716:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574172.281025:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290050176 00000100:00100000:2.0:1787574172.281036:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290050176 00000100:00100000:2.0:1787574172.281187:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787574172.281198:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290050176:12345-0@lo:400: 00000100:00100000:2.0:1787574172.281268:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290050176:12345-0@lo:400: Request processed in 72us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574172.281276:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787574172.281326:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff982a0355c000 x1874407290050176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574172.281344:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290050176:0@lo:400: 00000100:00100000:0.0:1787574172.327651:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04966450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+9:6679:x1874407290049280:12345-0@lo:253: Request processed in 86667us (87118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574172.327670:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787574172.327821:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290049280:0@lo:253: 10000000:01000000:1.0:1787574172.327840:0:6679:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787574172.327845:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787574172.327846:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787574172.327848:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787574172.327849:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787574172.327850:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787574172.327852:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787574172.327853:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787574172.327855:0:6679:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787574172.327857:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787574172.327873:0:6679:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787574172.327895:0:6679:0:(tgt_mount.c:101:server_register_mount()) register mount ffff982a41658000 from lustre-OST0000 10000000:01000000:1.0:1787574172.328023:0:6679:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787574172.328027:0:6679:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787574172.328036:0:6679:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff982a0488b370 local copy 10000000:01000000:1.0:1787574172.328040:0:6679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787574172.328150:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42044600/0xfe91058e646bf584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.328162:0:6679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.151@tcp lock: ffff982a42044600/0xfe91058e646bf584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.328247:0:6679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a42044600/0xfe91058e646bf584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574172.328269:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290050304:0@lo:101: 00000100:00100000:1.0:1787574172.328317:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574172.328425:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a11372780 going to sleep for 11 seconds 00000100:00100000:0.0:1787574172.328524:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290050304 00000100:00100000:0.0:1787574172.328533:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290050304 00000100:00100000:0.0:1787574172.328617:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787574172.328628:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04965050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+9:6679:x1874407290050304:12345-0@lo:101: 00010000:00010000:0.0:1787574172.328756:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574172.328775:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a00031c00/0xfe91058e646bf58b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf584 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574172.328800:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a00031c00/0xfe91058e646bf58b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf584 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574172.328811:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a00031c00/0xfe91058e646bf58b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf584 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574172.328822:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a00031c00, rc 0) 00000100:00100000:0.0:1787574172.330568:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04965050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+10:6679:x1874407290050304:12345-0@lo:101: Request processed in 1930us (2238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574172.330581:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787574172.330781:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290050304:0@lo:101: 00010000:00010000:1.0:1787574172.330808:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a42044600/0xfe91058e646bf584 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xfe91058e646bf58b expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.330822:0:6679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a42044600/0xfe91058e646bf584 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xfe91058e646bf58b expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574172.331005:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290050432:0@lo:501: 00000100:00100000:1.0:1787574172.331130:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574172.331210:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a11372780 going to sleep for 11 seconds 00000100:00100000:3.0:1787574172.331340:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290050432 00000100:00100000:3.0:1787574172.331349:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290050432 00000100:00100000:3.0:1787574172.331397:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787574172.331408:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04964c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+10:6679:x1874407290050432:12345-0@lo:501: 00000100:00100000:3.0:1787574172.331746:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04964c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+10:6679:x1874407290050432:12345-0@lo:501: Request processed in 339us (616us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787574172.331755:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787574172.331892:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290050432:0@lo:501: 10000000:01000000:1.0:1787574172.331909:0:6679:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787574172.331947:0:6679:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787574172.331954:0:6679:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42044600/0xfe91058e646bf584 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xfe91058e646bf58b expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.331965:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42044600/0xfe91058e646bf584 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xfe91058e646bf58b expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.331986:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff982a42044600/0xfe91058e646bf584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xfe91058e646bf58b expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.332012:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787574172.332038:0:6679:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff982a41658000 10000000:01000000:1.0:1787574172.332043:0:6679:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787574172.332128:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574172.332137:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a42044600/0xfe91058e646bf584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xfe91058e646bf58b expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574172.332144:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a42044600 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:2.0:1787574172.332148:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a42044600/0xfe91058e646bf584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xfe91058e646bf58b expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574172.332157:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a42044600/0xfe91058e646bf584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xfe91058e646bf58b expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574172.332194:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a42044600/0xfe91058e646bf584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xfe91058e646bf58b expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574172.332206:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787574172.332233:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a42044600/0xfe91058e646bf584 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xfe91058e646bf58b expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574172.332239:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787574172.332260:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a42044600/0xfe91058e646bf584 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xfe91058e646bf58b expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574172.332267:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a42044600/0xfe91058e646bf584 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xfe91058e646bf58b expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574172.332288:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574172.332290:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574172.332291:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574172.332299:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574172.332313:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290050560:0@lo:103: 00000100:00100000:2.0:1787574172.332353:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574172.332396:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290050560 00000100:00100000:2.0:1787574172.332400:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290050560 00000100:00100000:2.0:1787574172.332438:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574172.332446:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+10:3301:x1874407290050560:12345-0@lo:103: 00010000:00010000:2.0:1787574172.332457:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574172.332472:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a00031c00/0xfe91058e646bf58b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfe91058e646bf584 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574172.332489:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574172.332517:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+9:3301:x1874407290050560:12345-0@lo:103: Request processed in 72us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574172.332531:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574172.332562:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290050560:0@lo:103: 10000000:01000000:1.0:1787574172.332727:0:6679:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff982a0488b370 10000000:01000000:1.0:1787574172.332731:0:6679:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787574172.332734:0:6679:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff982a0488b370 from 1 10000000:01000000:1.0:1787574172.332737:0:6679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787574172.332759:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42044e00/0xfe91058e646bf592 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.332766:0:6679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a42044e00/0xfe91058e646bf592 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.332774:0:6679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a42044e00/0xfe91058e646bf592 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574172.332786:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290050688:0@lo:101: 00000100:00100000:1.0:1787574172.332817:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574172.332839:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a11372780 going to sleep for 11 seconds 00000100:00100000:3.0:1787574172.332893:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290050688 00000100:00100000:3.0:1787574172.332897:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290050688 00000100:00100000:3.0:1787574172.332929:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787574172.332937:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04967850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+9:6679:x1874407290050688:12345-0@lo:101: 00010000:00010000:3.0:1787574172.332947:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574172.332960:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a027f2400/0xfe91058e646bf599 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf592 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.332988:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a027f2400/0xfe91058e646bf599 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf592 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.332999:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a027f2400/0xfe91058e646bf599 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf592 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.333006:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a027f2400, rc 0) 00000100:00100000:3.0:1787574172.333113:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04967850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+10:6679:x1874407290050688:12345-0@lo:101: Request processed in 109us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574172.333130:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787574172.333378:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290050688:0@lo:101: 00010000:00010000:1.0:1787574172.333399:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a42044e00/0xfe91058e646bf592 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf599 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.333408:0:6679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a42044e00/0xfe91058e646bf592 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf599 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574172.333432:0:6679:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787574172.333452:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42044e00/0xfe91058e646bf592 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf599 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.333460:0:6679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a42044e00/0xfe91058e646bf592 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf599 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574172.333466:0:6679:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787574172.333470:0:6679:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787574172.333475:0:6679:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787574172.333477:0:6679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787574172.333494:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42045200/0xfe91058e646bf5a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.333500:0:6679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a42045200/0xfe91058e646bf5a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.333507:0:6679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a42045200/0xfe91058e646bf5a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574172.333520:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290050816:0@lo:101: 00000100:00100000:1.0:1787574172.333550:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574172.333580:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a11372780 going to sleep for 11 seconds 00000100:00100000:3.0:1787574172.333713:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290050816 00000100:00100000:3.0:1787574172.333718:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290050816 00000100:00100000:3.0:1787574172.333748:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787574172.333755:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+10:6679:x1874407290050816:12345-0@lo:101: 00010000:00010000:3.0:1787574172.333762:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574172.333771:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a027f3600/0xfe91058e646bf5a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf5a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.333784:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a027f3600/0xfe91058e646bf5a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf5a0 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.333791:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a027f3600/0xfe91058e646bf5a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf5a0 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.333798:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a027f3600, rc 0) 00000100:00100000:3.0:1787574172.333834:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+11:6679:x1874407290050816:12345-0@lo:101: Request processed in 79us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574172.333839:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787574172.333942:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290050816:0@lo:101: 00010000:00010000:1.0:1787574172.333959:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a42045200/0xfe91058e646bf5a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf5a7 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.333975:0:6679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a42045200/0xfe91058e646bf5a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf5a7 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574172.334202:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290050944:0@lo:501: 00000100:00100000:1.0:1787574172.334228:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574172.334300:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a11372780 going to sleep for 11 seconds 00000100:00100000:0.0:1787574172.334413:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290050944 00000100:00100000:0.0:1787574172.334419:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290050944 00000100:00100000:0.0:1787574172.334456:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787574172.334471:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+11:6679:x1874407290050944:12345-0@lo:501: 00000100:00100000:0.0:1787574172.334835:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+11:6679:x1874407290050944:12345-0@lo:501: Request processed in 365us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574172.334845:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787574172.334941:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290050944:0@lo:501: 00000100:00100000:1.0:1787574172.334984:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290051072:0@lo:503: 00000100:00100000:1.0:1787574172.335023:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574172.335042:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a11372780 going to sleep for 11 seconds 00000100:00100000:2.0:1787574172.335142:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290051072 00000100:00100000:2.0:1787574172.335147:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290051072 00000100:00100000:2.0:1787574172.335205:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787574172.335213:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+11:6679:x1874407290051072:12345-0@lo:503: 00000100:00100000:2.0:1787574172.335365:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+11:6679:x1874407290051072:12345-0@lo:503: Request processed in 153us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574172.335372:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787574172.335488:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290051072:0@lo:503: 00000040:00080000:1.0:1787574172.335851:0:6679:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787574172.335930:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290051200:0@lo:502: 00000100:00100000:1.0:1787574172.336006:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574172.336082:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a11445a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574172.336290:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290051200 00000100:00100000:2.0:1787574172.336295:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290051200 00000100:00100000:2.0:1787574172.336321:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787574172.336327:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+11:6679:x1874407290051200:12345-0@lo:502: 00000100:00100000:2.0:1787574172.336496:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+11:6679:x1874407290051200:12345-0@lo:502: Request processed in 167us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574172.336503:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787574172.336703:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290051200:0@lo:502: 00000040:00080000:1.0:1787574172.337032:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787574172.337144:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787574172.337264:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787574172.337322:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787574172.337359:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787574172.337392:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787574172.337426:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290051328:0@lo:502: 00000100:00100000:1.0:1787574172.337481:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574172.337514:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a11372780 going to sleep for 11 seconds 00000100:00100000:2.0:1787574172.337610:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290051328 00000100:00100000:2.0:1787574172.337616:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290051328 00000100:00100000:2.0:1787574172.337751:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787574172.337760:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+11:6679:x1874407290051328:12345-0@lo:502: 00000100:00100000:2.0:1787574172.337916:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+11:6679:x1874407290051328:12345-0@lo:502: Request processed in 157us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574172.338010:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787574172.339662:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290051328:0@lo:502: 00000040:00080000:0.0:1787574172.339853:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787574172.339869:0:6679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1787574172.340727:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787574172.340736:0:6697:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787574172.340743:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574172.340746:0:6697:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787574172.340751:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787574172.340780:0:6697:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff982904c78000) 00000020:00000080:0.0:1787574172.340803:0:6697:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787574172.340808:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787574172.340865:0:6697:0:(tgt_mount.c:153:server_get_mount()) get mount ffff982a41658000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787574172.340873:0:6697:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787574172.340880:0:6697:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xfe91058e646bf5b5 00010000:00010000:1.0:1787574172.351877:0:6697:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1787574172.352348:0:6697:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1787574172.357455:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787574172.358450:0:6697:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787574172.373306:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787574172.373959:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787574172.375758:0:6697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787574172.375771:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574172.375777:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574172.375779:0:6697:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787574172.375782:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574172.375785:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574172.375786:0:6697:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787574172.375789:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787574172.375791:0:6697:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787574172.375851:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574172.375855:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574172.375865:0:6697:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787574172.375869:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787574172.376193:0:6679:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1787574172.376223:0:6679:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787574172.376251:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42045200/0xfe91058e646bf5a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf5a7 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574172.376278:0:6679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a42045200/0xfe91058e646bf5a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf5a7 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574172.376287:0:6679:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982a41658000 from 1 10000000:01000000:2.0:1787574172.376290:0:6679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787574172.376335:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa800/0xfe91058e646bf5bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574172.376343:0:6679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa800/0xfe91058e646bf5bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574172.376355:0:6679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa800/0xfe91058e646bf5bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574172.376383:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290051456:0@lo:101: 00000100:00100000:2.0:1787574172.376464:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574172.376522:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a035a7240 going to sleep for 11 seconds 00000100:00100000:0.0:1787574172.376777:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290051456 00000100:00100000:0.0:1787574172.376787:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290051456 00000100:00100000:0.0:1787574172.376830:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787574172.376841:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+11:6679:x1874407290051456:12345-0@lo:101: 00010000:00010000:0.0:1787574172.376857:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574172.376872:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a00030000/0xfe91058e646bf5c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf5bc expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574172.376899:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a00030000/0xfe91058e646bf5c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf5bc expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574172.376909:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a00030000/0xfe91058e646bf5c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf5bc expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574172.376919:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a00030000, rc 0) 00000100:00100000:0.0:1787574172.377030:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+12:6679:x1874407290051456:12345-0@lo:101: Request processed in 189us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574172.377037:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787574172.377473:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290051456:0@lo:101: 00010000:00010000:3.0:1787574172.377492:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa800/0xfe91058e646bf5bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf5c3 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.377502:0:6679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa800/0xfe91058e646bf5bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf5c3 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574172.379224:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290051584:0@lo:501: 00000100:00100000:2.0:1787574172.379294:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574172.379340:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a035a7900 going to sleep for 11 seconds 00000100:00100000:1.0:1787574172.379441:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290051584 00000100:00100000:1.0:1787574172.379450:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290051584 00000100:00100000:1.0:1787574172.379507:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787574172.379517:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:6679:x1874407290051584:12345-0@lo:501: 00000100:00100000:1.0:1787574172.379779:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:6679:x1874407290051584:12345-0@lo:501: Request processed in 264us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574172.379786:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787574172.380185:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290051584:0@lo:501: 00000100:00100000:2.0:1787574172.380223:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290051712:0@lo:503: 00000100:00100000:2.0:1787574172.380358:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574172.380396:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a035a7900 going to sleep for 11 seconds 00000100:00100000:1.0:1787574172.380729:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290051712 00000100:00100000:1.0:1787574172.380734:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290051712 00000100:00100000:1.0:1787574172.380774:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787574172.380782:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+12:6679:x1874407290051712:12345-0@lo:503: 00000100:00100000:1.0:1787574172.381119:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+12:6679:x1874407290051712:12345-0@lo:503: Request processed in 336us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574172.381126:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787574172.381236:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290051712:0@lo:503: 00000040:00080000:2.0:1787574172.381545:0:6679:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787574172.381628:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290051840:0@lo:502: 00000100:00100000:2.0:1787574172.384507:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574172.384627:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a035a7900 going to sleep for 11 seconds 00000100:00100000:3.0:1787574172.385956:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290051840 00000100:00100000:3.0:1787574172.385980:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290051840 00000100:00100000:3.0:1787574172.386078:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787574172.386109:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+12:6679:x1874407290051840:12345-0@lo:502: 00000100:00100000:3.0:1787574172.386947:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+12:6679:x1874407290051840:12345-0@lo:502: Request processed in 835us (2444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574172.386958:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787574172.388772:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290051840:0@lo:502: 00000040:00080000:3.0:1787574172.389571:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787574172.389721:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787574172.389822:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290051968:0@lo:502: 00000100:00100000:3.0:1787574172.389961:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574172.390269:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9829047a09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574172.393220:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290051968 00000100:00100000:1.0:1787574172.393241:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290051968 00000100:00100000:0.0:1787574172.393444:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787574172.393458:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:6679:x1874407290051968:12345-0@lo:502: 00000100:00100000:0.0:1787574172.393747:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:6679:x1874407290051968:12345-0@lo:502: Request processed in 292us (3787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574172.393756:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787574172.394219:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290051968:0@lo:502: 00000040:00080000:3.0:1787574172.394397:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787574172.394414:0:6679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787574172.400689:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574172.400705:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574172.400709:0:6701:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787574172.400722:0:6701:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982a41658000 00000020:00000080:3.0:1787574172.400724:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787574172.400746:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574172.400750:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574172.400751:0:6701:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787574172.400755:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787574172.400926:0:6679:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787574172.400953:0:6679:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787574172.401019:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa800/0xfe91058e646bf5bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf5c3 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574172.401031:0:6679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa800/0xfe91058e646bf5bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf5c3 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574172.401076:0:6679:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787574172.401079:0:6679:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff982a41658000 10000000:01000000:2.0:1787574172.401083:0:6679:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff982a41658000 10000000:01000000:2.0:1787574172.401087:0:6679:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787574172.401093:0:6679:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982a41658000 from 1 10000000:01000000:2.0:1787574172.401096:0:6679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787574172.401140:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab200/0xfe91058e646bf5ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574172.401155:0:6679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab200/0xfe91058e646bf5ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574172.401189:0:6679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab200/0xfe91058e646bf5ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574172.401213:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290052096:0@lo:101: 00000100:00100000:2.0:1787574172.401284:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574172.401333:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a035a7000 going to sleep for 11 seconds 00000100:00100000:1.0:1787574172.401420:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290052096 00000100:00100000:1.0:1787574172.401427:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290052096 00000100:00100000:1.0:1787574172.401475:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787574172.401485:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+12:6679:x1874407290052096:12345-0@lo:101: 00010000:00010000:1.0:1787574172.401497:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574172.401511:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a42045800/0xfe91058e646bf5d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf5ca expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.401547:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a42045800/0xfe91058e646bf5d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf5ca expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.401557:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a42045800/0xfe91058e646bf5d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf5ca expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574172.401565:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a42045800, rc 0) 00000100:00100000:1.0:1787574172.401611:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+13:6679:x1874407290052096:12345-0@lo:101: Request processed in 127us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574172.401617:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787574172.401764:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290052096:0@lo:101: 00010000:00010000:2.0:1787574172.401784:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab200/0xfe91058e646bf5ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf5d1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574172.401789:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574172.401794:0:6679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab200/0xfe91058e646bf5ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf5d1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574172.401904:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290052224:0@lo:501: 00000100:00100000:2.0:1787574172.401931:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574172.401955:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a035a7000 going to sleep for 11 seconds 00000100:00100000:1.0:1787574172.402014:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290052224 00000100:00100000:1.0:1787574172.402019:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290052224 00000100:00100000:1.0:1787574172.402050:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787574172.402058:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+13:6679:x1874407290052224:12345-0@lo:501: 00000100:00100000:1.0:1787574172.402313:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+13:6679:x1874407290052224:12345-0@lo:501: Request processed in 254us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574172.402321:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787574172.402461:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290052224:0@lo:501: 00000100:00100000:2.0:1787574172.402489:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290052352:0@lo:503: 00000100:00100000:2.0:1787574172.402528:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574172.402547:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a035a7000 going to sleep for 11 seconds 00000100:00100000:1.0:1787574172.402598:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290052352 00000100:00100000:1.0:1787574172.402603:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290052352 00000100:00100000:1.0:1787574172.402635:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787574172.402642:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+13:6679:x1874407290052352:12345-0@lo:503: 00000100:00100000:1.0:1787574172.402787:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+13:6679:x1874407290052352:12345-0@lo:503: Request processed in 145us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574172.402794:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787574172.402863:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290052352:0@lo:503: 00000040:00080000:2.0:1787574172.403130:0:6679:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787574172.403202:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290052480:0@lo:502: 00000100:00100000:2.0:1787574172.403237:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574172.403263:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a035a7000 going to sleep for 11 seconds 00000100:00100000:0.0:1787574172.403382:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290052480 00000100:00100000:0.0:1787574172.403387:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290052480 00000100:00100000:0.0:1787574172.403425:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787574172.403451:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+13:6679:x1874407290052480:12345-0@lo:502: 00000100:00100000:0.0:1787574172.403615:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+13:6679:x1874407290052480:12345-0@lo:502: Request processed in 165us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574172.403623:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787574172.403684:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290052480:0@lo:502: 00000040:00080000:2.0:1787574172.403925:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787574172.403986:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787574172.404022:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787574172.404067:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787574172.404120:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787574172.404393:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787574172.404432:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787574172.404468:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787574172.404524:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787574172.404558:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787574172.404590:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787574172.404633:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787574172.404669:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787574172.404705:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787574172.404753:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787574172.404790:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787574172.404824:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787574172.404869:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787574172.404904:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787574172.404939:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787574172.405015:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787574172.405049:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787574172.405079:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787574172.405493:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787574172.405539:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787574172.405571:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787574172.405631:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787574172.405728:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787574172.405772:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290052608:0@lo:502: 00000100:00100000:2.0:1787574172.405845:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574172.405924:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a035a7000 going to sleep for 11 seconds 00000100:00100000:1.0:1787574172.405964:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290052608 00000100:00100000:1.0:1787574172.405984:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290052608 00000100:00100000:1.0:1787574172.406068:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787574172.406083:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+13:6679:x1874407290052608:12345-0@lo:502: 00000100:00100000:2.0:1787574172.406452:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+13:6679:x1874407290052608:12345-0@lo:502: Request processed in 370us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574172.406460:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787574172.407296:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290052608:0@lo:502: 00000040:00080000:3.0:1787574172.407407:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787574172.407421:0:6679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787574172.414772:0:6702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787574172.414793:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff982a048899b8) 00000020:00000080:3.0:1787574172.414831:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1787574172.414943:0:6702:0:(tgt_mount.c:153:server_get_mount()) get mount ffff982a41658000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787574172.414947:0:6702:0:(tgt_mount.c:187:server_put_mount()) put mount ffff982a41658000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787574172.414950:0:6702:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982a41658000 3 00010000:00080000:3.0:1787574172.415001:0:6702:0:(ldlm_lib.c:102:import_set_conn()) imp ffff982904f35800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1787574172.423526:0:6702:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1787574172.423786:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787574172.423825:0:6702:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787574172.423839:0:6702:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xfe91058e646bf5df 00000100:00080000:3.0:1787574172.423849:0:6702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787574172.423855:0:6702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff982904f35800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1787574172.423897:0:6702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982a40fe3480 x1874407290052736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787574172.423930:0:6702:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787574172.424025:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1874407290052736:0@lo:38: 00000100:00100000:1.0:1787574172.424093:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787574172.424625:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1787574172.424898:0:6679:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787574172.424924:0:6679:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787574172.424943:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab200/0xfe91058e646bf5ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf5d1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574172.424978:0:6679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab200/0xfe91058e646bf5ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf5d1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787574172.425019:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787574172.425021:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787574172.425023:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574172.425024:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574172.425026:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574172.425027:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574172.425029:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787574172.425031:0:6679:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787574172.425032:0:6679:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787574172.425034:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574172.425035:0:6679:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787574172.425038:0:6679:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787574172.425040:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787574172.425042:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787574172.425043:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574172.425044:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574172.425045:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574172.425046:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574172.425047:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787574172.425048:0:6679:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787574172.425049:0:6679:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787574172.425050:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574172.425051:0:6679:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787574172.425070:0:6679:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787574172.425082:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290052864:0@lo:253: 00000100:00100000:2.0:1787574172.425128:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574172.425235:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a035a7600 going to sleep for 11 seconds 00000100:00100000:0.0:1787574172.425463:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290052736 00000100:00100000:0.0:1787574172.425470:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290052736 00000100:00100000:0.0:1787574172.425509:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787574172.425516:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1874407290052736:12345-0@lo:38: 00010000:00080000:0.0:1787574172.425539:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:0.0:1787574172.425572:0:5832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xfe91058e646bf5e6 00000004:00100000:0.0:1787574172.425584:0:5832:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787574172.425616:0:5832:0:(import.c:65:import_set_state_nolock()) ffff982a3a5c5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574172.425665:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874407290052736:12345-0@lo:38: Request processed in 148us (1571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574172.425672:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787574172.425708:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a40fe3480 x1874407290052736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574172.425719:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787574172.425726:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787574172.425732:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787574172.425736:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787574172.425738:0:3297:0:(import.c:65:import_set_state_nolock()) ffff982904f35800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787574172.425744:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1874407290052736:0@lo:38: 00000100:00100000:1.0:1787574172.428197:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290052864 00000100:00100000:1.0:1787574172.428212:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290052864 00000100:00100000:1.0:1787574172.428269:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787574172.428279:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+13:6679:x1874407290052864:12345-0@lo:253: 20000000:01000000:1.0:1787574172.428311:0:5825:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787574172.428330:0:5825:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787574172.460535:0:5825:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787574172.460550:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787574172.460557:0:5846:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787574172.460563:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787574172.460583:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982a00031600/0xfe91058e646bf5ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574172.460608:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a027f2e00/0xfe91058e646bf54c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf545 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574172.460617:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982a00031600/0xfe91058e646bf5ed lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574172.460665:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a027f2e00/0xfe91058e646bf54c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf545 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574172.460680:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a027f2e00/0xfe91058e646bf54c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf545 expref: 13 pid: 5823 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574172.460695:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1874407290052992:0@lo:104: 00000100:00100000:0.0:1787574172.460761:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574172.460816:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a03d546c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574172.460839:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290052992 00000100:00100000:0.0:1787574172.460845:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290052992 00000100:00100000:0.0:1787574172.460902:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787574172.460912:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7182851c-b624-4982-87cf-e891100b1765+3:5846:x1874407290052992:12345-0@lo:104: 00010000:00010000:0.0:1787574172.460924:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a00030800/0xfe91058e646bf545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf54c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574172.461014:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787574172.461020:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7182851c-b624-4982-87cf-e891100b1765+3:5846:x1874407290052992:12345-0@lo:104: Request processed in 110us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574172.461028:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787574172.461041:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1874407290052992:0@lo:104: 00010000:00010000:1.0:1787574172.461058:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982a00031600/0xfe91058e646bf5ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.461104:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574172.461111:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a00030800/0xfe91058e646bf545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf54c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.461118:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030800 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1787574172.461122:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a00030800/0xfe91058e646bf545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf54c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.461130:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a00030800/0xfe91058e646bf545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf54c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574172.461137:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a00030800/0xfe91058e646bf545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf54c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574172.461143:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787574172.461212:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a00030800/0xfe91058e646bf545 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf54c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.461219:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574172.461238:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a00030800/0xfe91058e646bf545 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf54c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.461244:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a00030800/0xfe91058e646bf545 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf54c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.461259:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574172.461261:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574172.461263:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574172.461272:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574172.461282:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290053120:0@lo:103: 00000100:00100000:3.0:1787574172.461327:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574172.461368:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290053120 00000100:00100000:3.0:1787574172.461372:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290053120 00010000:00010000:3.0:1787574172.461391:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a027f2e00/0xfe91058e646bf54c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf545 expref: 14 pid: 5823 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574172.461412:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787574172.461419:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+14:3300:x1874407290053120:12345-0@lo:103: 00010000:00010000:3.0:1787574172.461428:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574172.461433:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a027f2e00/0xfe91058e646bf54c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf545 expref: 14 pid: 5823 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.461443:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a027f2e00/0xfe91058e646bf54c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf545 expref: 14 pid: 5823 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.461456:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a027f2e00/0xfe91058e646bf54c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf545 expref: 14 pid: 5823 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.461473:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982a00031600/0xfe91058e646bf5ed lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.461480:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a00031600/0xfe91058e646bf5ed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787574172.461492:0:5817:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001178774s 00010000:00010000:3.0:1787574172.461495:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a00031600/0xfe91058e646bf5ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.461500:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a00031600/0xfe91058e646bf5ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.461504:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982a00031600/0xfe91058e646bf5ed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.461508:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982a00031600/0xfe91058e646bf5ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.461511:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00031600 already unused, calling callback (ffffffffc142f230) 00010000:00010000:3.0:1787574172.461514:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982a00031600/0xfe91058e646bf5ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.461518:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982a00031600/0xfe91058e646bf5ed lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.461532:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982a00031600/0xfe91058e646bf5ed lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574172.461541:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574172.461548:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982a00031600/0xfe91058e646bf5ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574172.461564:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982a00031600/0xfe91058e646bf5ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574172.461571:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a00031600/0xfe91058e646bf5ed lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574172.461572:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+13:3300:x1874407290053120:12345-0@lo:103: Request processed in 155us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574172.461579:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787574172.461630:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290053120:0@lo:103: 00000100:00100000:0.0:1787574172.471656:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:6679:x1874407290052864:12345-0@lo:253: Request processed in 43369us (46517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574172.471671:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787574172.471823:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:6679:1874407290052864:0@lo:253: 10000000:01000000:2.0:1787574172.471839:0:6679:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787574172.471842:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787574172.471844:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787574172.471858:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574172.471860:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574172.471861:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574172.471862:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574172.471864:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787574172.471865:0:6679:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787574172.471866:0:6679:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787574172.471868:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574172.471869:0:6679:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787574172.471883:0:6679:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787574172.480156:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787574172.480462:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787574172.480711:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787574172.481150:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787574172.481530:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787574172.482073:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787574172.483242:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787574172.663493:0:6679:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787574172.663501:0:6679:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787574172.663541:0:6679:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787574172.663602:0:6679:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787574172.663619:0:6679:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787574172.663717:0:6679:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787574173.425756:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574174.450464:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574175.473493:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574176.497846:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574177.521442:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574177.905417:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290053504:0@lo:400: 00000100:00100000:0.0:1787574177.905484:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574177.905573:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290053504 00000100:00100000:0.0:1787574177.905581:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290053504 00000100:00100000:0.0:1787574177.905632:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787574177.905640:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290053504:12345-0@lo:400: 00000100:00100000:0.0:1787574177.905692:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290053504:12345-0@lo:400: Request processed in 53us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574177.905700:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787574177.905721:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787574177.905749:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a41f6ea00 x1874407290053504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574177.905772:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290053504:0@lo:400: 00000100:00100000:2.0:1787574177.905969:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290053376:0@lo:400: 00000100:00100000:2.0:1787574177.906002:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574177.906033:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787574177.906040:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290053248:0@lo:400: 00000100:00100000:2.0:1787574177.906067:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574177.906094:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290053248 00000100:00100000:2.0:1787574177.906099:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290053248 00000100:00100000:2.0:1787574177.906129:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787574177.906137:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+12:3299:x1874407290053248:12345-0@lo:400: 00000100:00100000:2.0:1787574177.906204:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+12:3299:x1874407290053248:12345-0@lo:400: Request processed in 68us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574177.906210:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787574177.906246:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290053248:0@lo:400: 00000100:00100000:0.0:1787574177.906375:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290053376 00000100:00100000:0.0:1787574177.906379:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290053376 00000100:00100000:0.0:1787574177.906402:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787574177.906409:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290053376:12345-0@lo:400: 00000100:00100000:0.0:1787574177.906442:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290053376:12345-0@lo:400: Request processed in 33us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574177.906447:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 10000000:01000000:2.0:1787574177.906507:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787574177.906511:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982a0622a800 from 21 10000000:01000000:2.0:1787574177.906515:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787574177.906540:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf5f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574177.906550:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf5f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574177.906571:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf5f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574177.906586:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290053632:0@lo:101: 00000100:00100000:2.0:1787574177.906610:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574177.906636:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0377ecc0 going to sleep for 11 seconds 00010000:00080000:2.0:1787574177.906655:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a41f6c380 x1874407290053376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574177.906665:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290053376:0@lo:400: 00000100:00100000:0.0:1787574177.906807:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290053632 00000100:00100000:0.0:1787574177.906812:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290053632 00000100:00100000:0.0:1787574177.906842:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787574177.906849:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a10091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+12:5827:x1874407290053632:12345-0@lo:101: 00010000:00010000:0.0:1787574177.906857:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574177.906868:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a00030a00/0xfe91058e646bf5fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf5f4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574177.906887:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a00030a00/0xfe91058e646bf5fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf5f4 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574177.906896:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a00030a00/0xfe91058e646bf5fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf5f4 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574177.906904:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a00030a00, rc 0) 00000100:00100000:0.0:1787574177.906931:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a10091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+13:5827:x1874407290053632:12345-0@lo:101: Request processed in 83us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574177.906953:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787574177.907022:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290053632:0@lo:101: 00010000:00010000:2.0:1787574177.907034:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf5f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf5fb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574177.907043:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf5f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf5fb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574177.907088:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290053760:0@lo:501: 00000100:00100000:2.0:1787574177.907112:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574177.907136:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0377ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574177.908421:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290053760 00000100:00100000:0.0:1787574177.908445:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290053760 00000100:00100000:0.0:1787574177.908489:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787574177.908498:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a10093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+13:5827:x1874407290053760:12345-0@lo:501: 00000100:00100000:0.0:1787574177.908799:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a10093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+13:5827:x1874407290053760:12345-0@lo:501: Request processed in 302us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574177.908807:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787574177.908971:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290053760:0@lo:501: 00000100:00100000:2.0:1787574177.909018:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290053888:0@lo:503: 00000100:00100000:2.0:1787574177.909066:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574177.909094:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0377ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574177.909109:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290053888 00000100:00100000:2.0:1787574177.909113:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290053888 00000100:00100000:2.0:1787574177.909147:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787574177.909153:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a10093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+13:5827:x1874407290053888:12345-0@lo:503: 00000100:00100000:2.0:1787574177.909337:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a10093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+13:5827:x1874407290053888:12345-0@lo:503: Request processed in 184us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574177.909345:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787574177.909382:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290053888:0@lo:503: 00000100:00100000:2.0:1787574177.909562:0:7016:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:7016:1874407290054016:0@lo:502: 00000100:00100000:2.0:1787574177.909593:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574177.909610:0:7016:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0dd52a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574177.909864:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290054016 00000100:00100000:0.0:1787574177.909868:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290054016 00000100:00100000:0.0:1787574177.909894:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787574177.909902:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+13:7016:x1874407290054016:12345-0@lo:502: 00000100:00100000:0.0:1787574177.910080:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+13:7016:x1874407290054016:12345-0@lo:502: Request processed in 179us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574177.910087:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787574177.910908:0:7016:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:7016:1874407290054016:0@lo:502: 00000100:00100000:2.0:1787574177.910979:0:7016:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:7016:1874407290054144:0@lo:502: 00000100:00100000:2.0:1787574177.911027:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574177.911064:0:7016:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a050096c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574177.911114:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290054144 00000100:00100000:0.0:1787574177.911119:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290054144 00000100:00100000:0.0:1787574177.911162:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787574177.911196:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+13:7016:x1874407290054144:12345-0@lo:502: 00000100:00100000:0.0:1787574177.911460:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+13:7016:x1874407290054144:12345-0@lo:502: Request processed in 264us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574177.911468:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787574177.911690:0:7016:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:7016:1874407290054144:0@lo:502: 00000040:00080000:2.0:1787574177.911713:0:7016:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1787574177.912268:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1787574177.912286:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787574177.912366:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf5f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf5fb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574177.912378:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf5f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf5fb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574177.912400:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787574177.912403:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff982a0622a800 from 4 10000000:01000000:0.0:1787574177.912406:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787574177.912436:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574177.912443:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574177.912452:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574177.912468:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290054272:0@lo:101: 00000100:00100000:0.0:1787574177.912509:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574177.912543:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a049153c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574177.912712:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290054272 00000100:00100000:2.0:1787574177.912719:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290054272 00000100:00100000:2.0:1787574177.912759:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787574177.912769:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+13:5827:x1874407290054272:12345-0@lo:101: 00010000:00010000:2.0:1787574177.912780:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574177.912792:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf609 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf602 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574177.912815:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf602 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574177.912836:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf602 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574177.912845:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a1d2ab400, rc 0) 00000100:00100000:2.0:1787574177.912879:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+14:5827:x1874407290054272:12345-0@lo:101: Request processed in 112us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574177.912886:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787574177.912920:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290054272:0@lo:101: 00010000:00010000:2.0:1787574177.912932:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf602 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf609 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574177.912952:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf602 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf609 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574177.913003:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290054400:0@lo:256: 00000100:00100000:2.0:1787574177.913033:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574177.913047:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a050096c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574177.913059:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290054400 00000100:00100000:2.0:1787574177.913063:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290054400 00000100:00100000:2.0:1787574177.913086:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787574177.913092:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+14:5827:x1874407290054400:12345-0@lo:256: 20000000:01000000:2.0:1787574177.913103:0:5825:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787574177.913118:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787574177.913121:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787574177.913212:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+14:5827:x1874407290054400:12345-0@lo:256: Request processed in 120us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574177.913218:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787574177.913250:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290054400:0@lo:256: 10000000:01000000:2.0:1787574177.913284:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787574177.913290:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf602 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf609 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574177.915047:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf609 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574177.915247:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787574177.915250:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787574177.915254:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787574177.915286:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf610 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574177.915305:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf610 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574177.915316:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf610 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574177.915338:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290054528:0@lo:101: 00000100:00100000:2.0:1787574177.915401:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574177.915611:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a050096c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574177.919242:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290054528 00000100:00100000:1.0:1787574177.919255:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290054528 00000100:00100000:1.0:1787574177.919309:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787574177.919319:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+14:5827:x1874407290054528:12345-0@lo:101: 00010000:00010000:1.0:1787574177.919335:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574177.919354:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a42045e00/0xfe91058e646bf617 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf610 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574177.919382:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a42045e00/0xfe91058e646bf617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf610 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574177.919393:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a42045e00/0xfe91058e646bf617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf610 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574177.919410:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a42045e00, rc 0) 00000100:00100000:1.0:1787574177.919492:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+15:5827:x1874407290054528:12345-0@lo:101: Request processed in 175us (4091us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574177.919499:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787574177.919556:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290054528:0@lo:101: 00010000:00010000:1.0:1787574177.919573:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf610 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf617 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574177.919582:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf610 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf617 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574177.919644:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290054656:0@lo:501: 00000100:00100000:1.0:1787574177.919672:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574177.919699:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff98290619c840 going to sleep for 11 seconds 00000100:00100000:1.0:1787574177.919712:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290054656 00000100:00100000:1.0:1787574177.919715:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290054656 00000100:00100000:1.0:1787574177.919734:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787574177.919741:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+15:5827:x1874407290054656:12345-0@lo:501: 00000100:00100000:1.0:1787574177.919982:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+15:5827:x1874407290054656:12345-0@lo:501: Request processed in 240us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574177.919989:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787574177.920021:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290054656:0@lo:501: 00000100:00100000:1.0:1787574177.920049:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290054784:0@lo:503: 00000100:00100000:1.0:1787574177.920086:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574177.920100:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff98290619c840 going to sleep for 11 seconds 00000100:00100000:1.0:1787574177.920118:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290054784 00000100:00100000:1.0:1787574177.920122:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290054784 00000100:00100000:1.0:1787574177.920141:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787574177.920147:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+15:5827:x1874407290054784:12345-0@lo:503: 00000100:00100000:1.0:1787574177.920369:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+15:5827:x1874407290054784:12345-0@lo:503: Request processed in 221us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574177.920376:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787574177.920413:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290054784:0@lo:503: 00000100:00100000:1.0:1787574177.920584:0:7018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:7018:1874407290054912:0@lo:502: 00000100:00100000:1.0:1787574177.920617:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574177.920636:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290054912 00000100:00100000:1.0:1787574177.920639:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290054912 00000100:00100000:1.0:1787574177.920661:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787574177.920667:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+15:7018:x1874407290054912:12345-0@lo:502: 00000100:00100000:1.0:1787574177.920849:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+15:7018:x1874407290054912:12345-0@lo:502: Request processed in 181us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574177.920855:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787574177.920885:0:7018:0:(client.c:2715:ptlrpc_set_wait()) set ffff98290619c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787574177.920896:0:7018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:7018:1874407290054912:0@lo:502: 00000020:01000000:1.0:1787574177.920916:0:7018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787574177.920924:0:7018:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787574177.920931:0:7018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574177.920934:0:7018:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787574177.920953:0:7018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787574177.920957:0:7018:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:1.0:1787574177.920980:0:7018:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787574177.920983:0:7018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787574177.921004:0:7018:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff982a03e90000) 00000020:00000080:1.0:1787574177.921025:0:7018:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1787574177.921032:0:7018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787574177.921105:0:7018:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787574177.921110:0:7018:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787574177.921118:0:7018:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfe91058e646bf625 00010000:00080000:1.0:1787574177.921148:0:7018:0:(ldlm_lib.c:102:import_set_conn()) imp ffff982a0571f000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:1.0:1787574177.921400:0:7018:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1787574178.056152:0:7018:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787574178.056218:0:7018:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787574178.056795:0:7018:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787574178.056993:0:7018:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787574178.057044:0:7018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1787574178.057106:0:7018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787574178.057844:0:7038:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787574178.057849:0:7038:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787574178.058520:0:7018:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787574178.058532:0:7018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787574178.058564:0:7018:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787574178.058586:0:7018:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfe91058e646bf62c 00000100:00080000:3.0:1787574178.058596:0:7018:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787574178.058612:0:7018:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff982a0571f000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1787574178.058645:0:7018:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982a40fe2a00 x1874407290055040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787574178.058684:0:7018:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787574178.058744:0:7018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574178.058749:0:7018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574178.058751:0:7018:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787574178.058754:0:7018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574178.058759:0:7018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574178.058760:0:7018:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787574178.058763:0:7018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787574178.058765:0:7018:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787574178.058793:0:7018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:7018:1874407290055168:0@lo:502: 00000100:00100000:3.0:1787574178.058875:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574178.058918:0:7018:0:(client.c:2715:ptlrpc_set_wait()) set ffff982906a610c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574178.059195:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874407290055040:0@lo:8: 00000100:00100000:1.0:1787574178.059233:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574178.059278:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290055168 00000100:00100000:1.0:1787574178.059284:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290055168 00000100:00100000:1.0:1787574178.059325:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787574178.059334:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+15:7018:x1874407290055168:12345-0@lo:502: 00000100:00100000:1.0:1787574178.059565:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+15:7018:x1874407290055168:12345-0@lo:502: Request processed in 230us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574178.059572:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787574178.059637:0:7018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:7018:1874407290055168:0@lo:502: 00000020:01000000:1.0:1787574178.059665:0:7018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574178.059670:0:7018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574178.059671:0:7018:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787574178.059675:0:7018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787574178.059791:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787574178.059811:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787574178.059819:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf610 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf617 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574178.059831:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf617 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574178.059851:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787574178.059853:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff982a0488b370 from 1 10000000:01000000:1.0:1787574178.059856:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787574178.059879:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42045000/0xfe91058e646bf633 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574178.059887:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a42045000/0xfe91058e646bf633 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574178.059895:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a42045000/0xfe91058e646bf633 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574178.059909:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290055296:0@lo:101: 00000100:00100000:1.0:1787574178.059947:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574178.059965:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff98290619c540 going to sleep for 11 seconds 00000100:00100000:3.0:1787574178.060108:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290055040 00000100:00100000:3.0:1787574178.060113:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290055040 00000100:00100000:3.0:1787574178.060146:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787574178.060151:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1874407290055040:12345-0@lo:8: 00010000:00080000:3.0:1787574178.060192:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:3.0:1787574178.060219:0:6681:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfe91058e646bf63a 00002000:00100000:3.0:1787574178.060255:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff982904f30800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787574178.060260:0:6681:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1787574178.060263:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787574178.060375:0:6681:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787574178.060521:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787574178.060549:0:6681:0:(import.c:65:import_set_state_nolock()) ffff982904f37800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787574178.060676:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3297:x1874407290055040:12345-0@lo:8: Request processed in 449us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574178.060684:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787574178.060783:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a40fe2a00 x1874407290055040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787574188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574178.060793:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787574178.060800:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787574178.060806:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787574178.060812:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787574178.060814:0:3297:0:(import.c:65:import_set_state_nolock()) ffff982a0571f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787574178.060836:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787574178.060841:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874407290055040:0@lo:8: 00000004:00080000:1.0:1787574178.060862:0:7038:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787574178.060971:0:7038:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 154235804788ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787574178.062004:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290055296 00000100:00100000:0.0:1787574178.062021:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290055296 00000100:00100000:0.0:1787574178.062142:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787574178.062155:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+15:5827:x1874407290055296:12345-0@lo:101: 00010000:00010000:0.0:1787574178.062196:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574178.062222:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a00031600/0xfe91058e646bf641 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf633 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574178.062256:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a00031600/0xfe91058e646bf641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf633 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574178.062271:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a00031600/0xfe91058e646bf641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf633 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574178.062298:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a00031600, rc 0) 00000100:00100000:0.0:1787574178.062391:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+16:5827:x1874407290055296:12345-0@lo:101: Request processed in 240us (2454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574178.062400:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787574178.062440:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290055296:0@lo:101: 00010000:00010000:1.0:1787574178.062477:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a42045000/0xfe91058e646bf633 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf641 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574178.062490:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a42045000/0xfe91058e646bf633 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf641 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574178.062558:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290055424:0@lo:501: 00000100:00100000:1.0:1787574178.064760:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574178.064977:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff98290619c540 going to sleep for 11 seconds 00000100:00100000:1.0:1787574178.065008:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290055424 00000100:00100000:1.0:1787574178.065016:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290055424 00000100:00100000:1.0:1787574178.065064:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787574178.065073:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a03487050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+16:5827:x1874407290055424:12345-0@lo:501: 00000100:00100000:1.0:1787574178.065379:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a03487050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+16:5827:x1874407290055424:12345-0@lo:501: Request processed in 304us (621us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787574178.065389:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787574178.065475:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290055424:0@lo:501: 10000000:01000000:1.0:1787574178.065519:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787574178.065530:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42045000/0xfe91058e646bf633 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf641 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574178.065541:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a42045000/0xfe91058e646bf633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf641 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787574178.112917:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787574178.176135:0:7039:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787574178.176195:0:7039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7039:1874407290055680:0@lo:7: 00000100:00100000:0.0:1787574178.176265:0:7039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574178.176325:0:7039:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a02e0c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574178.176349:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290055552:0@lo:13: 00000100:00100000:0.0:1787574178.176372:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574178.176412:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290055680 00000100:00100000:0.0:1787574178.176418:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290055680 00000100:00100000:0.0:1787574178.176471:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574178.176479:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7039:x1874407290055680:12345-0@lo:7: 00000001:02000400:2.0:1787574178.191883:0:7049:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1787574178.195752:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574178.195791:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290055552 00000100:00100000:1.0:1787574178.195802:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290055552 00000100:00100000:1.0:1787574178.195858:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787574178.195878:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874407290055552:12345-0@lo:13: 00002000:00000024:1.0:1787574178.195911:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787574178.196014:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874407290055552:12345-0@lo:13: Request processed in 138us (19640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574178.196021:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:0.0:1787574178.197722:0:6683:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787574178.197729:0:6683:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787574178.197814:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7039:x1874407290055680:12345-0@lo:7: Request processed in 21332us (21544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574178.197824:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787574178.197914:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a41f6f480 x1874407290055552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574178.197950:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290055552:0@lo:13: 00010000:00080000:1.0:1787574178.198435:0:7039:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a41f6fb80 x1874407290055680/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787574194 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574178.198446:0:7039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7039:1874407290055680:0@lo:7: 00000004:00080000:1.0:1787574178.198455:0:7039:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787574178.198491:0:7039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f73480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7039:1874407290055808:0@lo:5: 00000100:00100000:1.0:1787574178.198530:0:7039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574178.198568:0:7039:0:(client.c:2715:ptlrpc_set_wait()) set ffff98290619c540 going to sleep for 11 seconds 00000100:00100000:1.0:1787574178.198589:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290055808 00000100:00100000:1.0:1787574178.198595:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290055808 00000100:00100000:1.0:1787574178.198688:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787574178.198697:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7039:x1874407290055808:12345-0@lo:5: 00002000:00080000:1.0:1787574178.198719:0:6682:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787574178.198723:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787574178.198978:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7039:x1874407290055808:12345-0@lo:5: Request processed in 282us (447us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787574178.198985:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787574178.199015:0:7039:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a41f73480 x1874407290055808/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787574194 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574178.199027:0:7039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f73480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7039:1874407290055808:0@lo:5: 00000004:00080000:1.0:1787574178.199035:0:7039:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787574178.199058:0:7039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f72680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7039:1874407290055936:0@lo:700: 00000100:00100000:1.0:1787574178.199092:0:7039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574178.199106:0:7039:0:(client.c:2715:ptlrpc_set_wait()) set ffff98290619c540 going to sleep for 11 seconds 00000100:00100000:0.0:1787574178.200862:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290055936 00000100:00100000:0.0:1787574178.200875:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290055936 00000100:00100000:0.0:1787574178.201083:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574178.201094:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7039:x1874407290055936:12345-0@lo:700: 00000100:00100000:0.0:1787574178.201146:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6f480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6690:1874407290056064:0@lo:700: 00000100:00100000:0.0:1787574178.202846:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574178.202889:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a02e0ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574178.203003:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290056064 00000100:00100000:1.0:1787574178.203010:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290056064 00000100:00100000:1.0:1787574178.203102:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787574178.203112:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6690:x1874407290056064:12345-0@lo:700: 40000000:02000000:1.0:1787574178.263684:0:5837:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1787574178.269651:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6690:x1874407290056064:12345-0@lo:700: Request processed in 66532us (66801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574178.269665:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787574178.272465:0:6690:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a41f6f480 x1874407290056064/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787574194 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574178.272485:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6f480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6690:1874407290056064:0@lo:700: 40000000:02000000:2.0:1787574178.272499:0:6690:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1787574178.370736:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1787574178.370756:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787574178.370913:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7039:x1874407290055936:12345-0@lo:700: Request processed in 169816us (171815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574178.370931:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787574178.371028:0:7039:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a41f72680 x1874407290055936/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787574194 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574178.371039:0:7039:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787574178.371054:0:7039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f72680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7039:1874407290055936:0@lo:700: 00000004:02000040:2.0:1787574178.407920:0:7039:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1787574178.425782:0:7039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7039:1874407290056192:0@lo:5: 00000100:00100000:2.0:1787574178.426903:0:7039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574178.426973:0:7039:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3d00e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787574178.427671:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290056192 00000100:00100000:3.0:1787574178.427679:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290056192 00000100:00100000:3.0:1787574178.427745:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787574178.427755:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7039:x1874407290056192:12345-0@lo:5: 00002000:00080000:3.0:1787574178.438105:0:6681:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787574178.438127:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1787574178.443930:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7039:x1874407290056192:12345-0@lo:5: Request processed in 16167us (17022us total) trans 4294967298 rc 0/0 00010000:00080000:2.0:1787574178.444012:0:7039:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a0355e680 x1874407290056192/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787574194 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574178.444018:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787574178.444044:0:7039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7039:1874407290056192:0@lo:5: 00000004:00080000:2.0:1787574178.444069:0:7039:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1787574178.564999:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574179.574707:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574180.593775:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574181.617367:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574182.642476:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574183.537682:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787574183.537718:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290056320:0@lo:13: 00000100:00100000:0.0:1787574183.537813:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574183.538122:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290056448:0@lo:400: 00000100:00100000:0.0:1787574183.538154:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574183.538536:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290056320 00000100:00100000:1.0:1787574183.538546:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290056320 00000100:00100000:1.0:1787574183.538619:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787574183.538632:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1874407290056320:12345-0@lo:13: 00002000:00000024:1.0:1787574183.538678:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574183.538903:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290056448 00000100:00100000:0.0:1787574183.538919:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290056448 00000100:00100000:1.0:1787574183.539469:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1874407290056320:12345-0@lo:13: Request processed in 835us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574183.539481:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574183.539578:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787574183.539588:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a03484050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+16:3299:x1874407290056448:12345-0@lo:400: 00000100:00100000:0.0:1787574183.539631:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a03484050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+16:3299:x1874407290056448:12345-0@lo:400: Request processed in 46us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574183.539638:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787574183.544978:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874407290056576:0@lo:400: 00000100:00100000:1.0:1787574183.545084:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574183.545141:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574183.545150:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290056704:0@lo:400: 00000100:00100000:1.0:1787574183.545191:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787574183.545278:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574183.545349:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290056448:0@lo:400: 00010000:00080000:1.0:1787574183.545372:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a41f6dc00 x1874407290056320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574183.547515:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290056320:0@lo:13: 00000100:00100000:1.0:1787574183.547779:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290056576 00000100:00100000:1.0:1787574183.547790:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290056576 00000100:00100000:1.0:1787574183.548501:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290056704 00000100:00100000:1.0:1787574183.548507:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290056704 00000100:00100000:1.0:1787574183.548540:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787574183.548551:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874407290056576:12345-0@lo:400: 00000100:00100000:1.0:1787574183.548666:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874407290056576:12345-0@lo:400: Request processed in 116us (3581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574183.548674:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787574183.548692:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787574183.548698:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290056704:12345-0@lo:400: 00000100:00100000:1.0:1787574183.549567:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290056704:12345-0@lo:400: Request processed in 865us (4371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574183.549578:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787574183.549641:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787574183.549685:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a41f72680 x1874407290056704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574183.549702:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290056704:0@lo:400: 00010000:00080000:1.0:1787574183.549731:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a41f71180 x1874407290056576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574183.549741:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874407290056576:0@lo:400: 00000001:00080000:1.0:1787574183.608216:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1787574183.667050:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574184.689727:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574185.713411:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574186.738658:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574187.763539:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574188.657580:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290056960:0@lo:400: 00000100:00100000:2.0:1787574188.657666:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574188.657733:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787574188.657739:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290056832:0@lo:400: 00000100:00100000:2.0:1787574188.657766:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574188.657795:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290057088:0@lo:400: 00000100:00100000:2.0:1787574188.657837:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574188.657857:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574188.657862:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290057216:0@lo:400: 00000100:00100000:2.0:1787574188.657895:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574188.657925:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290056960 00000100:00100000:2.0:1787574188.657932:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290056960 00000100:00100000:2.0:1787574188.657977:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290057088 00000100:00100000:2.0:1787574188.657980:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290057088 00000100:00100000:2.0:1787574188.658009:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787574188.658018:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290056960:12345-0@lo:400: 00000100:00100000:2.0:1787574188.658080:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290056960:12345-0@lo:400: Request processed in 63us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574188.658088:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787574188.658106:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787574188.658113:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290057088:12345-0@lo:400: 00000100:00100000:2.0:1787574188.658145:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290057088:12345-0@lo:400: Request processed in 33us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574188.658152:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787574188.658191:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290056832 00000100:00100000:2.0:1787574188.658195:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290056832 00000100:00100000:2.0:1787574188.658218:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787574188.658225:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a03485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+16:3299:x1874407290056832:12345-0@lo:400: 00000100:00100000:2.0:1787574188.658269:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a03485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+16:3299:x1874407290056832:12345-0@lo:400: Request processed in 44us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574188.658276:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787574188.658309:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290057216 00000100:00100000:2.0:1787574188.658312:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290057216 00000100:00100000:2.0:1787574188.658350:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574188.658357:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290057216:12345-0@lo:400: 00000100:00100000:2.0:1787574188.658388:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290057216:12345-0@lo:400: Request processed in 32us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574188.658394:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787574188.658413:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574188.658416:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787574188.658443:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a0355d880 x1874407290057216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574188.658453:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787574188.658468:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290057216:0@lo:400: 00010000:00080000:2.0:1787574188.658480:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a0355f800 x1874407290057088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574188.658489:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290057088:0@lo:400: 00000100:00100000:2.0:1787574188.658510:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290056832:0@lo:400: 00010000:00080000:2.0:1787574188.658521:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a0355d180 x1874407290056960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574188.658530:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290056960:0@lo:400: 00000100:00100000:1.0:1787574188.658794:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290057344:0@lo:13: 00000100:00100000:1.0:1787574188.658829:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574188.658960:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290057344 00000100:00100000:2.0:1787574188.658965:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290057344 00000100:00100000:2.0:1787574188.658999:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787574188.659007:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290057344:12345-0@lo:13: 00002000:00000024:2.0:1787574188.659032:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787574188.659511:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290057344:12345-0@lo:13: Request processed in 503us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574188.659533:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787574188.659592:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a41f6d500 x1874407290057344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574188.659609:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290057344:0@lo:13: 00010000:00010000:2.0:1787574188.786659:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787574189.798475:0:7630:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787574189.798479:0:7630:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787574189.798622:0:7630:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff982a3a5c3000 00000020:01000004:0.0:1787574189.798641:0:7630:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787574189.798657:0:7630:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787574189.798671:0:7630:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff982904c799b8) 00000020:00000080:0.0:1787574189.798687:0:7630:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00010000:00010000:3.0:1787574189.809422:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787574189.816670:0:7630:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1787574189.816972:0:7630:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787574189.844429:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787574189.852088:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787574189.852126:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787574189.852303:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787574189.852458:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787574189.852933:0:7630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787574189.852947:0:7630:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787574189.852957:0:7630:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xfe91058e646bf64f 00000020:01000004:2.0:1787574189.852966:0:7630:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787574189.852988:0:7630:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787574189.852991:0:7630:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787574189.852996:0:7630:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787574189.853020:0:7630:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787574189.853024:0:7630:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787574189.885527:0:7630:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787574189.885734:0:7630:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.151@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1787574189.885739:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787574189.885741:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787574189.885742:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574189.885743:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574189.885745:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574189.885746:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574189.885748:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787574189.885749:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787574189.885756:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787574189.885758:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574189.885760:0:7630:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787574189.885764:0:7630:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1787574189.885768:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787574189.885769:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787574189.885770:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574189.885771:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574189.885772:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574189.885773:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574189.885774:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787574189.885775:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787574189.885783:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787574189.885784:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574189.885784:0:7630:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787574189.885823:0:7630:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787574189.885849:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290057472:0@lo:253: 00000100:00100000:3.0:1787574189.885951:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574189.886076:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a07df6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574189.886142:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290057472 00000100:00100000:1.0:1787574189.886153:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290057472 00000100:00100000:1.0:1787574189.886303:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787574189.886314:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+16:7630:x1874407290057472:12345-0@lo:253: 20000000:01000000:1.0:1787574189.886354:0:5825:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787574189.886359:0:5825:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787574189.886366:0:5825:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787574189.886370:0:5825:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787574189.887900:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574189.888287:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787574189.888303:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787574189.888350:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787574189.888358:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787574189.888390:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787574189.888447:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787574189.888995:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787574189.889019:0:5825:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.151@tcp 20000000:01000000:1.0:1787574189.889022:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.151@tcp (null) (null) (null) 00000040:00080000:1.0:1787574189.889058:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787574189.889066:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787574189.891808:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787574189.891838:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.151@tcp (null) (null) 00000040:00080000:1.0:1787574189.891897:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787574189.891925:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787574189.891962:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787574189.892018:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787574189.893052:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787574189.893088:0:5825:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.151@tcp 20000000:01000000:1.0:1787574189.893090:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.151@tcp (null) (null) (null) 00000040:00080000:1.0:1787574189.893127:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787574189.893134:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787574189.893162:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787574189.893202:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.151@tcp (null) (null) 00000040:00080000:1.0:1787574189.893238:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787574189.893247:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787574189.893293:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787574189.893332:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787574189.893348:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787574189.893352:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787574189.893356:0:5825:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787574189.893373:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787574189.893376:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787574189.893414:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787574189.893416:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787574189.896268:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787574189.896755:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787574189.896803:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787574189.896892:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1787574189.896905:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787574189.896908:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787574189.903789:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787574189.903912:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787574189.903975:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787574189.904653:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787574189.904699:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787574189.904771:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1787574189.904786:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787574189.904789:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787574189.907009:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1787574189.907119:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1787574189.907226:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787574189.907697:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1787574189.907744:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1787574189.907796:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1787574189.907811:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787574189.907814:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787574189.908719:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1787574189.908820:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1787574189.908856:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1787574189.909675:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1787574189.909733:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1787574189.909807:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1787574189.909831:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1787574189.909833:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1787574189.909844:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787574189.909881:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf656 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574189.909904:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a027f3600/0xfe91058e646bf5a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf5a0 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574189.909912:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a42045800/0xfe91058e646bf5d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf5ca expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574189.909918:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a00030a00/0xfe91058e646bf5fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf5f4 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574189.909924:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a42045e00/0xfe91058e646bf617 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf610 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574189.909930:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a00031600/0xfe91058e646bf641 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf633 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574189.909937:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf656 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574189.909991:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a00031600/0xfe91058e646bf641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf633 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574189.910008:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a00031600/0xfe91058e646bf641 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf633 expref: 16 pid: 5824 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574189.910025:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1874407290057600:0@lo:104: 00000100:00100000:2.0:1787574189.910299:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574189.910405:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a42045e00/0xfe91058e646bf617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf610 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574189.910415:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a42045e00/0xfe91058e646bf617 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf610 expref: 16 pid: 5825 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574189.910424:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1874407290057728:0@lo:104: 00010000:00010000:2.0:1787574189.910450:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a00030a00/0xfe91058e646bf5fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf5f4 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574189.910458:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a00030a00/0xfe91058e646bf5fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf5f4 expref: 16 pid: 5825 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574189.910465:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1874407290057856:0@lo:104: 00010000:00010000:2.0:1787574189.910489:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a42045800/0xfe91058e646bf5d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf5ca expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574189.910497:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a42045800/0xfe91058e646bf5d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf5ca expref: 16 pid: 5823 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574189.910505:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1874407290057984:0@lo:104: 00010000:00010000:2.0:1787574189.910529:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a027f3600/0xfe91058e646bf5a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf5a0 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574189.910547:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a027f3600/0xfe91058e646bf5a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf5a0 expref: 16 pid: 5825 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574189.910556:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1874407290058112:0@lo:104: 00000100:00100000:2.0:1787574189.910589:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04f700c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574189.910765:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787574189.910793:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574189.910854:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574189.910917:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574189.910937:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290057600 00000100:00100000:3.0:1787574189.910946:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290057600 00000100:00100000:3.0:1787574189.910997:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290057728 00000100:00100000:3.0:1787574189.911000:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290057728 00000100:00100000:3.0:1787574189.911009:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290057856 00000100:00100000:3.0:1787574189.911011:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290057856 00000100:00100000:3.0:1787574189.911025:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787574189.911035:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0791b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+5:5825:x1874407290057600:12345-0@lo:104: 00010000:00010000:3.0:1787574189.911049:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a42045000/0xfe91058e646bf633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf641 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.911467:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787574189.911475:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0791b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+5:5825:x1874407290057600:12345-0@lo:104: Request processed in 440us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574189.911483:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787574189.911755:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1874407290057600:0@lo:104: 00010000:00010000:1.0:1787574189.911817:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574189.911826:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a42045000/0xfe91058e646bf633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf641 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.911834:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a42045000 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:1.0:1787574189.911838:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a42045000/0xfe91058e646bf633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf641 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.911848:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a42045000/0xfe91058e646bf633 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf641 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574189.911856:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a42045000/0xfe91058e646bf633 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf641 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574189.911863:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574189.911917:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a42045000/0xfe91058e646bf633 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf641 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.911924:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574189.911945:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a42045000/0xfe91058e646bf633 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf641 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.911952:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a42045000/0xfe91058e646bf633 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf641 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.911968:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574189.911970:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574189.911972:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574189.911980:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574189.912005:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290058240:0@lo:103: 00000100:00100000:1.0:1787574189.912047:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574189.913335:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787574189.913362:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+4:5825:x1874407290057728:12345-0@lo:104: 00010000:00010000:3.0:1787574189.913382:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf617 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.913491:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787574189.913498:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+4:5825:x1874407290057728:12345-0@lo:104: Request processed in 148us (2703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574189.913521:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787574189.913639:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1874407290057728:0@lo:104: 00000100:00100000:3.0:1787574189.913693:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787574189.913702:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+3:5825:x1874407290057856:12345-0@lo:104: 00010000:00010000:3.0:1787574189.913711:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf5f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf5fb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.913793:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574189.913800:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf617 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.913807:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2abe00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:1.0:1787574189.913811:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf617 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.913820:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf617 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574189.913827:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf617 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574189.913833:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574189.913881:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf610 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf617 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.913888:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574189.913909:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf610 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf617 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.913916:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf610 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf617 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.913931:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574189.913934:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574189.913935:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574189.913949:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290058368:0@lo:103: 00000100:00100000:1.0:1787574189.913997:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574189.914056:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290058240 00000100:00100000:1.0:1787574189.914064:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290058240 00010000:00010000:1.0:1787574189.914101:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a00031600/0xfe91058e646bf641 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf633 expref: 17 pid: 5824 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574189.914128:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290058368 00000100:00100000:1.0:1787574189.914131:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290058368 00010000:00010000:1.0:1787574189.914143:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a42045e00/0xfe91058e646bf617 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf610 expref: 18 pid: 5825 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574189.914156:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787574189.914163:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+18:3298:x1874407290058240:12345-0@lo:103: 00010000:00010000:1.0:1787574189.914201:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574189.914207:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a00031600/0xfe91058e646bf641 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf633 expref: 18 pid: 5824 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.914219:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a00031600/0xfe91058e646bf641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf633 expref: 18 pid: 5824 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.914233:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a00031600/0xfe91058e646bf641 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf633 expref: 18 pid: 5824 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.914252:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574189.914283:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+17:3298:x1874407290058240:12345-0@lo:103: Request processed in 121us (2235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574189.914290:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787574189.914306:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787574189.914312:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+16:3300:x1874407290058368:12345-0@lo:103: 00010000:00010000:1.0:1787574189.914319:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574189.914329:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a42045e00/0xfe91058e646bf617 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf610 expref: 16 pid: 5825 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.914338:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a42045e00/0xfe91058e646bf617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf610 expref: 16 pid: 5825 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.914348:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a42045e00/0xfe91058e646bf617 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf610 expref: 16 pid: 5825 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.914357:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574189.914383:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+15:3300:x1874407290058368:12345-0@lo:103: Request processed in 72us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574189.914389:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787574189.914424:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290058368:0@lo:103: 00000100:00100000:1.0:1787574189.914452:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290058240:0@lo:103: 00010000:00010000:3.0:1787574189.914533:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787574189.914548:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+3:5825:x1874407290057856:12345-0@lo:104: Request processed in 847us (3693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574189.914553:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787574189.914657:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574189.914662:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf5f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf5fb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.914670:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2aba00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:1.0:1787574189.914673:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf5f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf5fb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.914681:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf5f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf5fb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574189.914688:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf5f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf5fb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574189.914693:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574189.914731:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf5f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf5fb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.914738:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574189.914750:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf5f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf5fb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.914757:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf5f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf5fb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.914767:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574189.914769:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574189.914771:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574189.914781:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290058496:0@lo:103: 00000100:00100000:1.0:1787574189.914810:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574189.914845:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290058496 00000100:00100000:1.0:1787574189.914849:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290058496 00010000:00010000:1.0:1787574189.914863:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a00030a00/0xfe91058e646bf5fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf5f4 expref: 15 pid: 5825 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574189.914896:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787574189.914903:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+15:3301:x1874407290058496:12345-0@lo:103: 00010000:00010000:1.0:1787574189.914910:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574189.914915:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a00030a00/0xfe91058e646bf5fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf5f4 expref: 15 pid: 5825 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.914923:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a00030a00/0xfe91058e646bf5fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf5f4 expref: 15 pid: 5825 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.914934:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574189.914968:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+15:3301:x1874407290058496:12345-0@lo:103: Request processed in 66us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574189.914974:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787574189.915001:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290058496:0@lo:103: 00000100:00100000:0.0:1787574189.915478:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574189.915492:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290057984 00000100:00100000:0.0:1787574189.915496:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290057984 00000100:00100000:0.0:1787574189.915521:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290058112 00000100:00100000:0.0:1787574189.915524:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290058112 00000100:00100000:3.0:1787574189.915624:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787574189.915634:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+4:5825:x1874407290057984:12345-0@lo:104: 00010000:00010000:3.0:1787574189.915646:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab200/0xfe91058e646bf5ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf5d1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.915708:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787574189.915714:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+4:5825:x1874407290057984:12345-0@lo:104: Request processed in 84us (4797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574189.915721:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787574189.915738:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787574189.915744:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+3:5825:x1874407290058112:12345-0@lo:104: 00010000:00010000:3.0:1787574189.915751:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a42045200/0xfe91058e646bf5a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf5a7 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.915784:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787574189.915788:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+3:5825:x1874407290058112:12345-0@lo:104: Request processed in 46us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574189.915803:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787574189.915820:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787574189.915825:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab200/0xfe91058e646bf5ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf5d1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.915830:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2ab200 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1787574189.915834:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab200/0xfe91058e646bf5ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf5d1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.915841:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab200/0xfe91058e646bf5ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf5d1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574189.915848:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab200/0xfe91058e646bf5ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf5d1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574189.915852:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787574189.915893:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab200/0xfe91058e646bf5ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf5d1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.915899:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574189.915913:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab200/0xfe91058e646bf5ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf5d1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.915919:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab200/0xfe91058e646bf5ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf5d1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.915931:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574189.915934:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a42045200/0xfe91058e646bf5a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf5a7 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.915950:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a42045200 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1787574189.915954:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a42045200/0xfe91058e646bf5a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf5a7 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.915960:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a42045200/0xfe91058e646bf5a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf5a7 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574189.915967:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a42045200/0xfe91058e646bf5a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf5a7 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574189.915973:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787574189.915988:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a42045200/0xfe91058e646bf5a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf5a7 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.915994:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574189.915999:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a42045200/0xfe91058e646bf5a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf5a7 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.916005:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a42045200/0xfe91058e646bf5a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf5a7 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.916023:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574189.916024:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574189.916026:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574189.916047:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290058624:0@lo:103: 00000100:00100000:3.0:1787574189.916091:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574189.916116:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574189.916121:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290058752:0@lo:103: 00000100:00100000:3.0:1787574189.916152:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574189.916207:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290058624 00000100:00100000:3.0:1787574189.916212:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290058624 00010000:00010000:3.0:1787574189.916231:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a42045800/0xfe91058e646bf5d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf5ca expref: 15 pid: 5823 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574189.916249:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290058752 00000100:00100000:3.0:1787574189.916252:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290058752 00010000:00010000:3.0:1787574189.916263:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a027f3600/0xfe91058e646bf5a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf5a0 expref: 16 pid: 5825 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574189.916274:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787574189.916280:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+16:3298:x1874407290058624:12345-0@lo:103: 00010000:00010000:3.0:1787574189.916291:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574189.916296:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a42045800/0xfe91058e646bf5d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf5ca expref: 16 pid: 5823 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.916306:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a42045800/0xfe91058e646bf5d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf5ca expref: 16 pid: 5823 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.916322:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574189.916351:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+16:3298:x1874407290058624:12345-0@lo:103: Request processed in 70us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574189.916357:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787574189.916370:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787574189.916375:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+15:3298:x1874407290058752:12345-0@lo:103: 00010000:00010000:3.0:1787574189.916383:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574189.916387:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a027f3600/0xfe91058e646bf5a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf5a0 expref: 15 pid: 5825 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.916406:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a027f3600/0xfe91058e646bf5a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf5a0 expref: 15 pid: 5825 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.916418:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf656 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.916426:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf656 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.916442:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf656 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.916448:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf656 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.916456:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf656 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.916462:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf656 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.916467:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2ab800 already unused, calling callback (ffffffffc142f230) 00010000:00010000:3.0:1787574189.916471:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf656 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.916478:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf656 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.916485:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf656 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.916506:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574189.916529:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+15:3298:x1874407290058752:12345-0@lo:103: Request processed in 154us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574189.916534:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787574189.916580:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290058752:0@lo:103: 00000100:00100000:3.0:1787574189.916588:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290058624:0@lo:103: 00010000:00010000:3.0:1787574189.916606:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574189.917423:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a00030a00/0xfe91058e646bf5fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf5f4 expref: 14 pid: 5825 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574189.917439:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1874407290057856:0@lo:104: 00010000:00010000:2.0:1787574189.918532:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a42045800/0xfe91058e646bf5d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf5ca expref: 13 pid: 5823 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574189.918619:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1874407290057984:0@lo:104: 00010000:00010000:2.0:1787574189.918636:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a027f3600/0xfe91058e646bf5a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf5a0 expref: 12 pid: 5825 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574189.918645:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1874407290058112:0@lo:104: 00010000:00010000:2.0:1787574189.918739:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf656 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574189.918750:0:5825:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf656 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574189.918755:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf656 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574189.918761:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf656 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787574189.918778:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787574189.973493:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+11:7630:x1874407290057472:12345-0@lo:253: Request processed in 87167us (87529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574189.973528:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787574189.973672:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290057472:0@lo:253: 10000000:01000000:3.0:1787574189.973692:0:7630:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787574189.973696:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787574189.973697:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787574189.973699:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574189.973700:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1787574189.973701:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574189.973702:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574189.973704:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787574189.973705:0:7630:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787574189.973707:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574189.973709:0:7630:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787574189.973730:0:7630:0:(tgt_mount.c:101:server_register_mount()) register mount ffff982a3a5c3000 from lustre-OST0001 10000000:01000000:3.0:1787574189.973760:0:7630:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787574189.973764:0:7630:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787574189.973773:0:7630:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff982a0488b370 local copy 10000000:01000000:3.0:1787574189.973778:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787574189.973820:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a027f2800/0xfe91058e646bf65d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.973832:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.151@tcp lock: ffff982a027f2800/0xfe91058e646bf65d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.973855:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a027f2800/0xfe91058e646bf65d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574189.973887:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290058880:0@lo:101: 00000100:00100000:3.0:1787574189.973931:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574189.974042:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a07df6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574189.974279:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290058880 00000100:00100000:1.0:1787574189.974289:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290058880 00000100:00100000:1.0:1787574189.974379:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787574189.974391:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+11:7630:x1874407290058880:12345-0@lo:101: 00010000:00010000:1.0:1787574189.974405:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574189.974421:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a42045e00/0xfe91058e646bf664 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf65d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.974450:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a42045e00/0xfe91058e646bf664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf65d expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.974462:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a42045e00/0xfe91058e646bf664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf65d expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.974472:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a42045e00, rc 0) 00000100:00100000:1.0:1787574189.974518:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+12:7630:x1874407290058880:12345-0@lo:101: Request processed in 129us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574189.974525:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787574189.974631:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290058880:0@lo:101: 00010000:00010000:3.0:1787574189.974646:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a027f2800/0xfe91058e646bf65d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xfe91058e646bf664 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.974657:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a027f2800/0xfe91058e646bf65d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xfe91058e646bf664 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574189.974771:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290059008:0@lo:501: 00000100:00100000:3.0:1787574189.974811:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574189.974908:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a07df6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574189.975008:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290059008 00000100:00100000:1.0:1787574189.975013:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290059008 00000100:00100000:1.0:1787574189.975031:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787574189.975038:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+12:7630:x1874407290059008:12345-0@lo:501: 00000100:00100000:1.0:1787574189.975294:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+12:7630:x1874407290059008:12345-0@lo:501: Request processed in 255us (481us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787574189.975310:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787574189.975383:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290059008:0@lo:501: 10000000:01000000:3.0:1787574189.975399:0:7630:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787574189.975426:0:7630:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787574189.975431:0:7630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a027f2800/0xfe91058e646bf65d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xfe91058e646bf664 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.975440:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a027f2800/0xfe91058e646bf65d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xfe91058e646bf664 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.975447:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff982a027f2800/0xfe91058e646bf65d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xfe91058e646bf664 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.975480:0:7630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787574189.975501:0:7630:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff982a3a5c3000 10000000:01000000:3.0:1787574189.975506:0:7630:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787574189.975512:0:7630:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787574189.975515:0:7630:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787574189.975519:0:7630:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787574189.975522:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787574189.975554:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf66b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.975562:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf66b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.975569:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf66b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574189.975582:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290059136:0@lo:101: 00000100:00100000:3.0:1787574189.975616:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574189.975635:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a02e0c300 going to sleep for 11 seconds 00010000:00010000:1.0:1787574189.975689:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574189.975697:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a027f2800/0xfe91058e646bf65d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xfe91058e646bf664 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.975705:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a027f2800 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:1.0:1787574189.975709:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a027f2800/0xfe91058e646bf65d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xfe91058e646bf664 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.975717:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a027f2800/0xfe91058e646bf65d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xfe91058e646bf664 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574189.975725:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a027f2800/0xfe91058e646bf65d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xfe91058e646bf664 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574189.975731:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574189.975752:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a027f2800/0xfe91058e646bf65d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xfe91058e646bf664 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.975759:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574189.975784:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a027f2800/0xfe91058e646bf65d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xfe91058e646bf664 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.975791:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a027f2800/0xfe91058e646bf65d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xfe91058e646bf664 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.975805:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574189.975807:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574189.975809:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574189.975818:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574189.975836:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290059264:0@lo:103: 00000100:00100000:1.0:1787574189.975864:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574189.975900:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290059136 00000100:00100000:1.0:1787574189.975904:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290059136 00000100:00100000:1.0:1787574189.975927:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787574189.975933:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+12:7630:x1874407290059136:12345-0@lo:101: 00010000:00010000:1.0:1787574189.975942:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574189.975952:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a42045000/0xfe91058e646bf672 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf66b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.975971:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a42045000/0xfe91058e646bf672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf66b expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.975980:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a42045000/0xfe91058e646bf672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf66b expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574189.975989:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a42045000, rc 0) 00000100:00100000:1.0:1787574189.976016:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+13:7630:x1874407290059136:12345-0@lo:101: Request processed in 83us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574189.976023:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787574189.976149:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290059264 00000100:00100000:3.0:1787574189.976153:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290059264 00000100:00100000:3.0:1787574189.976227:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787574189.976235:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+13:3301:x1874407290059264:12345-0@lo:103: 00010000:00010000:3.0:1787574189.976246:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574189.976260:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a42045e00/0xfe91058e646bf664 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfe91058e646bf65d expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.976271:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574189.976310:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+12:3301:x1874407290059264:12345-0@lo:103: Request processed in 76us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574189.976317:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787574189.976347:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290059264:0@lo:103: 00000100:00100000:3.0:1787574189.976376:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290059136:0@lo:101: 00010000:00010000:3.0:1787574189.976388:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf66b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf672 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574189.976396:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf66b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf672 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574189.976492:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290059392:0@lo:501: 00000100:00100000:3.0:1787574189.976527:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574189.976678:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a02e0c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787574189.976755:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290059392 00000100:00100000:1.0:1787574189.976759:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290059392 00000100:00100000:1.0:1787574189.976780:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787574189.976786:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+12:7630:x1874407290059392:12345-0@lo:501: 00000100:00100000:1.0:1787574189.977025:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+12:7630:x1874407290059392:12345-0@lo:501: Request processed in 237us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574189.977033:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787574189.977112:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290059392:0@lo:501: 00000100:00100000:3.0:1787574189.977143:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290059520:0@lo:503: 00000100:00100000:3.0:1787574189.977227:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574189.977250:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a02e0c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787574189.977303:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290059520 00000100:00100000:2.0:1787574189.977308:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290059520 00000100:00100000:2.0:1787574189.977337:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787574189.977345:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+12:7630:x1874407290059520:12345-0@lo:503: 00000100:00100000:2.0:1787574189.977518:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+12:7630:x1874407290059520:12345-0@lo:503: Request processed in 173us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574189.977525:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787574189.977683:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290059520:0@lo:503: 00000040:00080000:3.0:1787574189.978002:0:7630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787574189.978074:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290059648:0@lo:502: 00000100:00100000:3.0:1787574189.978115:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574189.978144:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a02e0c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787574189.978254:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290059648 00000100:00100000:1.0:1787574189.978259:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290059648 00000100:00100000:1.0:1787574189.978292:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787574189.978299:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+12:7630:x1874407290059648:12345-0@lo:502: 00000100:00100000:1.0:1787574189.978459:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+12:7630:x1874407290059648:12345-0@lo:502: Request processed in 160us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574189.978466:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787574189.978657:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290059648:0@lo:502: 00000040:00080000:3.0:1787574189.978946:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787574189.979007:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787574189.979042:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787574189.979103:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787574189.979142:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787574189.979295:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787574189.979331:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290059776:0@lo:502: 00000100:00100000:3.0:1787574189.979382:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574189.979454:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a02e0c300 going to sleep for 11 seconds 00000100:00100000:0.0:1787574189.979514:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290059776 00000100:00100000:0.0:1787574189.979521:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290059776 00000100:00100000:1.0:1787574189.979639:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787574189.979652:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+12:7630:x1874407290059776:12345-0@lo:502: 00000100:00100000:1.0:1787574189.979860:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+12:7630:x1874407290059776:12345-0@lo:502: Request processed in 211us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574189.979868:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787574189.980030:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290059776:0@lo:502: 00000040:00080000:3.0:1787574189.980116:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787574189.980126:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787574189.980754:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787574189.980764:0:7638:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787574189.980771:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574189.980773:0:7638:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787574189.980779:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787574189.980796:0:7638:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff982a03e919b8) 00000020:00000080:1.0:1787574189.980821:0:7638:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787574189.980827:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787574189.980903:0:7638:0:(tgt_mount.c:153:server_get_mount()) get mount ffff982a3a5c3000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787574189.980911:0:7638:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787574189.980918:0:7638:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xfe91058e646bf680 00010000:00010000:3.0:1787574189.987892:0:7638:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1787574189.988284:0:7638:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787574189.990960:0:7638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787574189.991334:0:7638:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787574189.996653:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787574189.998217:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787574190.003354:0:7638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787574190.003369:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574190.003379:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574190.003381:0:7638:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787574190.003387:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574190.003392:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574190.003393:0:7638:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787574190.003396:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787574190.003398:0:7638:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787574190.003474:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574190.003478:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574190.003479:0:7638:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787574190.003483:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787574190.005084:0:7630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787574190.005123:0:7630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787574190.005154:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf66b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf672 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574190.005192:0:7630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf66b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf672 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574190.005202:0:7630:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982a3a5c3000 from 1 10000000:01000000:3.0:1787574190.005205:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787574190.005253:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a027f2000/0xfe91058e646bf687 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574190.005282:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a027f2000/0xfe91058e646bf687 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574190.005298:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a027f2000/0xfe91058e646bf687 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574190.005330:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290059904:0@lo:101: 00000100:00100000:3.0:1787574190.005413:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574190.005461:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a06668240 going to sleep for 11 seconds 00000100:00100000:1.0:1787574190.006753:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290059904 00000100:00100000:1.0:1787574190.006767:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290059904 00000100:00100000:1.0:1787574190.006842:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787574190.006854:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+12:7630:x1874407290059904:12345-0@lo:101: 00010000:00010000:1.0:1787574190.006886:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574190.006905:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a42044a00/0xfe91058e646bf68e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf687 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574190.006952:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a42044a00/0xfe91058e646bf68e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf687 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574190.006965:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a42044a00/0xfe91058e646bf68e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf687 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574190.006987:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a42044a00, rc 0) 00000100:00100000:1.0:1787574190.007074:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+13:7630:x1874407290059904:12345-0@lo:101: Request processed in 222us (1661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574190.007082:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787574190.007270:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290059904:0@lo:101: 00010000:00010000:2.0:1787574190.007292:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a027f2000/0xfe91058e646bf687 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf68e expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574190.007304:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a027f2000/0xfe91058e646bf687 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf68e expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574190.007444:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290060032:0@lo:501: 00000100:00100000:2.0:1787574190.007484:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574190.007519:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04f700c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574190.007692:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290060032 00000100:00100000:0.0:1787574190.007698:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290060032 00000100:00100000:0.0:1787574190.007739:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787574190.007748:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+13:7630:x1874407290060032:12345-0@lo:501: 00000100:00100000:0.0:1787574190.008032:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+13:7630:x1874407290060032:12345-0@lo:501: Request processed in 285us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574190.008040:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787574190.008071:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290060032:0@lo:501: 00000100:00100000:0.0:1787574190.008106:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290060160:0@lo:503: 00000100:00100000:0.0:1787574190.008157:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574190.008194:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff9829047a0000 going to sleep for 11 seconds 00000100:00100000:0.0:1787574190.008214:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290060160 00000100:00100000:0.0:1787574190.008217:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290060160 00000100:00100000:0.0:1787574190.008234:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787574190.008240:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+13:7630:x1874407290060160:12345-0@lo:503: 00000100:00100000:0.0:1787574190.008685:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+13:7630:x1874407290060160:12345-0@lo:503: Request processed in 444us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574190.008693:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787574190.008729:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290060160:0@lo:503: 00000040:00080000:0.0:1787574190.009036:0:7630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787574190.009105:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290060288:0@lo:502: 00000100:00100000:0.0:1787574190.009155:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574190.009195:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a07a09180 going to sleep for 11 seconds 00000100:00100000:0.0:1787574190.009223:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290060288 00000100:00100000:0.0:1787574190.009227:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290060288 00000100:00100000:0.0:1787574190.009251:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787574190.009258:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+13:7630:x1874407290060288:12345-0@lo:502: 00000100:00100000:0.0:1787574190.009447:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+13:7630:x1874407290060288:12345-0@lo:502: Request processed in 188us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574190.009454:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787574190.009490:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290060288:0@lo:502: 00000040:00080000:0.0:1787574190.010136:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787574190.010409:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787574190.010451:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290060416:0@lo:502: 00000100:00100000:0.0:1787574190.010508:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574190.010597:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056aa840 going to sleep for 11 seconds 00000100:00100000:1.0:1787574190.014834:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290060416 00000100:00100000:1.0:1787574190.014853:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290060416 00000100:00100000:1.0:1787574190.014937:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787574190.014949:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+13:7630:x1874407290060416:12345-0@lo:502: 00000100:00100000:1.0:1787574190.015525:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+13:7630:x1874407290060416:12345-0@lo:502: Request processed in 576us (5014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574190.015652:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290060416:0@lo:502: 00000040:00080000:0.0:1787574190.015844:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787574190.015860:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787574190.016243:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574190.016253:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574190.016255:0:7642:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787574190.016262:0:7642:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982a3a5c3000 00000020:00000080:0.0:1787574190.016265:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787574190.016281:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574190.016284:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574190.016285:0:7642:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787574190.016288:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787574190.016697:0:7630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787574190.016721:0:7630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787574190.016742:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a027f2000/0xfe91058e646bf687 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf68e expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574190.016756:0:7630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a027f2000/0xfe91058e646bf687 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf68e expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574190.016799:0:7630:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787574190.016802:0:7630:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff982a3a5c3000 10000000:01000000:0.0:1787574190.016806:0:7630:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff982a3a5c3000 10000000:01000000:0.0:1787574190.016810:0:7630:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787574190.016816:0:7630:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982a3a5c3000 from 1 10000000:01000000:0.0:1787574190.016819:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787574190.016856:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574190.016865:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574190.018674:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:0.0:1787574190.019087:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574190.019120:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290060544:0@lo:101: 00000100:00100000:0.0:1787574190.019326:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574190.019405:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a06668d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574190.023080:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290060544 00000100:00100000:3.0:1787574190.023099:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290060544 00000100:00100000:3.0:1787574190.023841:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787574190.023858:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+13:7630:x1874407290060544:12345-0@lo:101: 00010000:00010000:3.0:1787574190.023894:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574190.023920:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a027f3a00/0xfe91058e646bf69c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf695 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574190.023955:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a027f3a00/0xfe91058e646bf69c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf695 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574190.023969:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a027f3a00/0xfe91058e646bf69c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf695 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574190.024337:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a027f3a00, rc 0) 00000100:00100000:3.0:1787574190.024629:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+14:7630:x1874407290060544:12345-0@lo:101: Request processed in 775us (5301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574190.024637:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787574190.026048:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290060544:0@lo:101: 00010000:00010000:0.0:1787574190.026083:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf695 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf69c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574190.026098:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf695 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf69c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574190.026290:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290060672:0@lo:501: 00000100:00100000:0.0:1787574190.026358:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574190.026409:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a06668d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574190.026862:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290060672 00000100:00100000:1.0:1787574190.026881:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290060672 00000100:00100000:1.0:1787574190.026941:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787574190.026953:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+14:7630:x1874407290060672:12345-0@lo:501: 00000100:00100000:1.0:1787574190.027294:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+14:7630:x1874407290060672:12345-0@lo:501: Request processed in 341us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574190.027304:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787574190.030278:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290060672:0@lo:501: 00000100:00100000:0.0:1787574190.030371:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290060800:0@lo:503: 00000100:00100000:0.0:1787574190.030468:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574190.030523:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a06668d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574190.032097:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290060800 00000100:00100000:3.0:1787574190.032127:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290060800 00000100:00100000:3.0:1787574190.032223:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787574190.032235:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+14:7630:x1874407290060800:12345-0@lo:503: 00000100:00100000:3.0:1787574190.032529:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+14:7630:x1874407290060800:12345-0@lo:503: Request processed in 294us (2059us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574190.033698:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290060800:0@lo:503: 00000100:00100000:3.0:1787574190.034657:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000040:00080000:1.0:1787574190.036850:0:7630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787574190.037281:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290060928:0@lo:502: 00000100:00100000:1.0:1787574190.037383:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574190.037444:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a07d7b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787574190.037837:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290060928 00000100:00100000:0.0:1787574190.037849:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290060928 00000100:00100000:0.0:1787574190.037916:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787574190.037928:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+14:7630:x1874407290060928:12345-0@lo:502: 00000100:00100000:0.0:1787574190.038283:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+14:7630:x1874407290060928:12345-0@lo:502: Request processed in 355us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574190.038299:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787574190.039785:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290060928:0@lo:502: 00000040:00080000:3.0:1787574190.040218:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787574190.040290:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787574190.040325:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787574190.040392:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787574190.040433:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787574190.040482:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787574190.040519:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787574190.041006:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787574190.041068:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787574190.041105:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787574190.041138:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787574190.041310:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787574190.041351:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787574190.041407:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787574190.041454:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787574190.041491:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787574190.041525:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787574190.041654:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787574190.041692:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787574190.041723:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787574190.041959:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787574190.042070:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787574190.042107:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787574190.042156:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787574190.042347:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787574190.042378:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787574190.042424:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787574190.042459:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1787574190.042492:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787574190.043144:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1787574190.043681:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1787574190.043719:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1787574190.044656:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1787574190.057608:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787574190.057900:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787574190.058403:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787574190.058517:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787574190.058584:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290061056:0@lo:502: 00000100:00100000:0.0:1787574190.058763:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574190.058821:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a064c3540 going to sleep for 11 seconds 00000100:00100000:3.0:1787574190.059531:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290061056 00000100:00100000:3.0:1787574190.059554:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290061056 00000100:00100000:3.0:1787574190.059621:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787574190.059633:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04966c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+14:7630:x1874407290061056:12345-0@lo:502: 00000100:00100000:3.0:1787574190.061076:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04966c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+14:7630:x1874407290061056:12345-0@lo:502: Request processed in 1437us (2305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574190.061092:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787574190.063908:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290061056:0@lo:502: 00000040:00080000:1.0:1787574190.064127:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1787574190.064146:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1787574190.065386:0:7643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787574190.065409:0:7643:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff982a03564d28) 00000020:00000080:2.0:1787574190.065437:0:7643:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1787574190.065945:0:7643:0:(tgt_mount.c:153:server_get_mount()) get mount ffff982a3a5c3000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787574190.065951:0:7643:0:(tgt_mount.c:187:server_put_mount()) put mount ffff982a3a5c3000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787574190.065954:0:7643:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982a3a5c3000 3 00010000:00080000:2.0:1787574190.065990:0:7643:0:(ldlm_lib.c:102:import_set_conn()) imp ffff982a4192c000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1787574190.071369:0:7643:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1787574190.071652:0:7643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787574190.071720:0:7643:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787574190.071736:0:7643:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xfe91058e646bf6aa 00000100:00080000:3.0:1787574190.071924:0:7643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787574190.071934:0:7643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff982a4192c000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1787574190.071981:0:7643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982a40fe2d80 x1874407290061184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787574190.072017:0:7643:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787574190.073668:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1874407290061184:0@lo:38: 00000100:00100000:0.0:1787574190.073849:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574190.073952:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290061184 00000100:00100000:0.0:1787574190.073962:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290061184 00000100:00100000:0.0:1787574190.074009:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787574190.074019:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1874407290061184:12345-0@lo:38: 00010000:00080000:0.0:1787574190.074051:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000100:00100000:2.0:1787574190.074276:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874407290061312:0@lo:400: 00000100:00100000:2.0:1787574190.074318:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574190.074365:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290061440:0@lo:400: 00000100:00100000:2.0:1787574190.074400:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574190.074418:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574190.074423:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290061568:0@lo:400: 00000100:00100000:2.0:1787574190.074451:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574190.074479:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787574190.074493:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000020:00000080:0.0:1787574190.074644:0:5832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xfe91058e646bf6b1 00000004:00100000:0.0:1787574190.074674:0:5832:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787574190.076992:0:5832:0:(import.c:65:import_set_state_nolock()) ffff982a40fc5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574190.077134:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1874407290061184:12345-0@lo:38: Request processed in 3112us (3283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574190.077147:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787574190.077201:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290061312 00000100:00100000:0.0:1787574190.077210:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290061312 00000100:00100000:0.0:1787574190.077245:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290061440 00000100:00100000:0.0:1787574190.077249:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290061440 00000100:00100000:0.0:1787574190.077282:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787574190.077292:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874407290061312:12345-0@lo:400: 00000100:00100000:0.0:1787574190.077356:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874407290061312:12345-0@lo:400: Request processed in 66us (3037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574190.077363:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787574190.077376:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787574190.077382:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290061440:12345-0@lo:400: 00000100:00100000:0.0:1787574190.077416:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290061440:12345-0@lo:400: Request processed in 34us (3016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574190.077422:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787574190.077459:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290061568 00000100:00100000:0.0:1787574190.077463:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290061568 00000100:00100000:0.0:1787574190.077494:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574190.077501:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290061568:12345-0@lo:400: 00000100:00100000:0.0:1787574190.077536:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290061568:12345-0@lo:400: Request processed in 35us (3084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574190.077542:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787574190.077557:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574190.077561:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787574190.077604:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a40fe2d80 x1874407290061184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574190.077618:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787574190.077628:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787574190.077637:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787574190.077644:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787574190.077646:0:3297:0:(import.c:65:import_set_state_nolock()) ffff982a4192c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787574190.077654:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1874407290061184:0@lo:38: 00010000:00080000:0.0:1787574190.077696:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a0355d880 x1874407290061312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574190.077714:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874407290061312:0@lo:400: 00010000:00080000:0.0:1787574190.077745:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a0355df80 x1874407290061568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574190.077754:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290061568:0@lo:400: 00010000:00080000:0.0:1787574190.077767:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a0355f800 x1874407290061440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574190.077775:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290061440:0@lo:400: 00000040:00080000:0.0:1787574190.077983:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1787574190.078193:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6ed80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7644:1874407290061696:0@lo:901: 00000100:00100000:0.0:1787574190.078242:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574190.078272:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a064c3180 going to sleep for 11 seconds 00000020:01000000:0.0:1787574190.078304:0:7630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787574190.078338:0:7630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787574190.078362:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf695 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf69c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574190.078374:0:7630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf69c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787574190.078428:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787574190.078430:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787574190.078431:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787574190.078433:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787574190.078434:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787574190.078436:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787574190.078437:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787574190.078439:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787574190.078445:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787574190.078447:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787574190.078448:0:7630:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787574190.078452:0:7630:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787574190.078454:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787574190.078455:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787574190.078456:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787574190.078457:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787574190.078458:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787574190.078459:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787574190.078460:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787574190.078461:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787574190.078462:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787574190.078463:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787574190.078464:0:7630:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787574190.078480:0:7630:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787574190.078489:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290061824:0@lo:253: 00000100:00100000:0.0:1787574190.078528:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574190.078554:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056aa480 going to sleep for 11 seconds 00000100:00100000:0.0:1787574190.078572:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290061824 00000100:00100000:0.0:1787574190.078577:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290061824 00000100:00100000:0.0:1787574190.078611:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787574190.078618:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04965450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+14:7630:x1874407290061824:12345-0@lo:253: 20000000:01000000:0.0:1787574190.078645:0:5825:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787574190.078665:0:5825:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787574190.081979:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290061696 00000100:00100000:2.0:1787574190.082000:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290061696 00000100:00100000:2.0:1787574190.082090:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574190.082102:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7644:x1874407290061696:12345-0@lo:901: 00000100:00100000:2.0:1787574190.082644:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7644:x1874407290061696:12345-0@lo:901: Request processed in 543us (4400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574190.082654:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787574190.085414:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787574190.091890:0:7644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a41f6ed80 x1874407290061696/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787574206 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574190.092153:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6ed80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7644:1874407290061696:0@lo:901: 20000000:01000000:0.0:1787574190.142288:0:5825:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787574190.142316:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787574190.142385:0:5846:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787574190.142391:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787574190.142428:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf6b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574190.142453:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf602 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574190.142463:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf6b8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574190.142517:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf602 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574190.142535:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf609 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf602 expref: 14 pid: 5824 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574190.142574:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1874407290061952:0@lo:104: 00000100:00100000:2.0:1787574190.142650:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574190.142729:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04f70300 going to sleep for 11 seconds 00000100:00100000:0.0:1787574190.142936:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290061952 00000100:00100000:0.0:1787574190.142947:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290061952 00000100:00100000:0.0:1787574190.143012:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787574190.143023:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+3:5846:x1874407290061952:12345-0@lo:104: 00010000:00010000:0.0:1787574190.143038:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf609 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574190.143112:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787574190.143119:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+3:5846:x1874407290061952:12345-0@lo:104: Request processed in 99us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574190.143127:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787574190.143150:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574190.143157:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf609 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574190.143191:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00031c00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:0.0:1787574190.143196:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf609 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574190.143207:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf609 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574190.143216:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf609 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574190.143223:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787574190.143257:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf602 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf609 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574190.143264:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574190.143283:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf602 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf609 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574190.143301:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf602 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf609 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574190.143321:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574190.143323:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574190.143325:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574190.143348:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290062080:0@lo:103: 00000100:00100000:0.0:1787574190.143386:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574190.143442:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290062080 00000100:00100000:0.0:1787574190.143446:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290062080 00010000:00010000:0.0:1787574190.143463:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf609 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf602 expref: 15 pid: 5824 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574190.143486:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787574190.143493:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+15:3300:x1874407290062080:12345-0@lo:103: 00010000:00010000:0.0:1787574190.143504:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574190.143509:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf609 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf602 expref: 15 pid: 5824 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574190.143519:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf609 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf602 expref: 15 pid: 5824 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574190.143536:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf6b8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574190.143544:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf6b8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787574190.143558:0:5815:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001178774s 00010000:00010000:0.0:1787574190.143568:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf6b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574190.143576:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf6b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574190.143584:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf6b8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574190.143590:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf6b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574190.143595:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2ab800 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574190.143599:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf6b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574190.143606:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf6b8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574190.143615:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf6b8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574190.143625:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574190.143651:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+15:3300:x1874407290062080:12345-0@lo:103: Request processed in 159us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574190.143659:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787574190.143733:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290062080:0@lo:103: 00010000:00010000:2.0:1787574190.144192:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf609 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf602 expref: 14 pid: 5824 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574190.144206:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1874407290061952:0@lo:104: 00010000:00010000:2.0:1787574190.144223:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf6b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574190.144232:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf6b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574190.144238:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf6b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574190.144244:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a1d2ab800/0xfe91058e646bf6b8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574190.171481:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04965450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+13:7630:x1874407290061824:12345-0@lo:253: Request processed in 92850us (92939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574190.171500:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787574190.172147:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7182851c-b624-4982-87cf-e891100b1765:7630:1874407290061824:0@lo:253: 10000000:01000000:1.0:1787574190.172210:0:7630:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787574190.172215:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787574190.172217:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787574190.172219:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787574190.172220:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787574190.172222:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787574190.172223:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787574190.172225:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787574190.172226:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787574190.172228:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787574190.172230:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787574190.172231:0:7630:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787574190.172249:0:7630:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787574190.183984:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787574190.184162:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787574190.184399:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787574190.184595:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787574190.184777:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787574190.185136:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787574190.192291:0:7630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787574190.468956:0:7630:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787574190.468967:0:7630:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787574190.469009:0:7630:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787574190.469086:0:7630:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787574190.469108:0:7630:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787574190.469147:0:7630:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787574190.833417:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574191.857426:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574192.882319:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574193.778668:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574193.778698:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290062208:0@lo:13: 00000100:00100000:2.0:1787574193.778900:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574193.779075:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290062208 00000100:00100000:1.0:1787574193.779086:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290062208 00000100:00100000:1.0:1787574193.779158:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787574193.779202:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290062208:12345-0@lo:13: 00002000:00000024:1.0:1787574193.779246:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787574193.779299:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290062208:12345-0@lo:13: Request processed in 101us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574193.779308:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787574193.779613:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787574193.779653:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a0355ea00 x1874407290062208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574193.779678:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290062208:0@lo:13: 00010000:00010000:0.0:1787574193.905496:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574194.932549:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574195.313413:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290062592:0@lo:400: 00000100:00100000:3.0:1787574195.313544:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290062336:0@lo:400: 00000100:00100000:3.0:1787574195.313628:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574195.313700:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290062848:0@lo:400: 00000100:00100000:3.0:1787574195.313748:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574195.313780:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574195.313785:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290062464:0@lo:400: 00000100:00100000:3.0:1787574195.313808:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574195.313886:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290062336 00000100:00100000:3.0:1787574195.313896:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290062336 00000100:00100000:2.0:1787574195.314247:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574195.314279:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574195.314286:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290062720:0@lo:400: 00000100:00100000:2.0:1787574195.314314:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574195.314346:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290062720 00000100:00100000:2.0:1787574195.314351:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290062720 00000100:00100000:2.0:1787574195.314401:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787574195.314414:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290062720:12345-0@lo:400: 00000100:00100000:1.0:1787574195.314586:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290062848 00000100:00100000:1.0:1787574195.314602:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290062848 00000100:00100000:1.0:1787574195.314635:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290062464 00000100:00100000:1.0:1787574195.314638:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290062464 00000100:00100000:1.0:1787574195.314652:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290062592 00000100:00100000:1.0:1787574195.314654:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290062592 00000100:00100000:1.0:1787574195.314811:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787574195.314820:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290062848:12345-0@lo:400: 00000100:00100000:1.0:1787574195.314895:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290062848:12345-0@lo:400: Request processed in 76us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574195.314902:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787574195.314930:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787574195.314936:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290062464:12345-0@lo:400: 00000100:00100000:3.0:1787574195.315187:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787574195.315197:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04967450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+13:3298:x1874407290062336:12345-0@lo:400: 00000100:00100000:3.0:1787574195.315238:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04967450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+13:3298:x1874407290062336:12345-0@lo:400: Request processed in 43us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574195.315244:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787574195.315279:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787574195.315286:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290062592:12345-0@lo:400: 00000100:00100000:3.0:1787574195.315320:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290062592:12345-0@lo:400: Request processed in 35us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574195.315327:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787574195.315862:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a0355d500 x1874407290062592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574195.315883:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290062592:0@lo:400: 00000100:00100000:3.0:1787574195.315931:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290062336:0@lo:400: 00000100:00100000:2.0:1787574195.316086:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290062720:12345-0@lo:400: Request processed in 1676us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574195.316094:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787574195.316116:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574195.316121:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787574195.316154:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a0355e300 x1874407290062720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574195.316175:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290062720:0@lo:400: 00000100:00100000:1.0:1787574195.317082:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290062464:12345-0@lo:400: Request processed in 1344us (2471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574195.317094:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787574195.317902:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a0355f800 x1874407290062848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574195.317933:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290062848:0@lo:400: 00010000:00080000:3.0:1787574195.317982:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a0355c700 x1874407290062464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574195.318015:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290062464:0@lo:400: 00010000:00010000:0.0:1787574195.955932:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787574196.578230:0:7987:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787574196.977754:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787574197.363297:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787574197.363306:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982a41658000 from 30 10000000:01000000:0.0:1787574197.363313:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787574197.363386:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf6bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574197.363401:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf6bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574197.363416:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf6bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574197.363449:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290062976:0@lo:101: 00000100:00100000:0.0:1787574197.363551:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574197.363628:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3d01da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574197.363704:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290062976 00000100:00100000:2.0:1787574197.363715:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290062976 00000100:00100000:2.0:1787574197.363787:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787574197.363801:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+13:5827:x1874407290062976:12345-0@lo:101: 00010000:00010000:2.0:1787574197.363818:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574197.363843:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a1d2ab000/0xfe91058e646bf6c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf6bf expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574197.363877:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a1d2ab000/0xfe91058e646bf6c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf6bf expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574197.363903:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a1d2ab000/0xfe91058e646bf6c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf6bf expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574197.363916:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a1d2ab000, rc 0) 00000100:00100000:2.0:1787574197.363967:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+14:5827:x1874407290062976:12345-0@lo:101: Request processed in 169us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574197.363974:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787574197.364029:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290062976:0@lo:101: 00010000:00010000:2.0:1787574197.364044:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf6bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf6c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574197.364055:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf6bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf6c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574197.364119:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290063104:0@lo:501: 00000100:00100000:2.0:1787574197.364146:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574197.364161:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a07a09e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787574197.364200:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290063104 00000100:00100000:2.0:1787574197.364204:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290063104 00000100:00100000:2.0:1787574197.364227:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787574197.364234:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+14:5827:x1874407290063104:12345-0@lo:501: 00000100:00100000:2.0:1787574197.364630:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+14:5827:x1874407290063104:12345-0@lo:501: Request processed in 395us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574197.364637:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787574197.364671:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290063104:0@lo:501: 00000100:00100000:2.0:1787574197.364700:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290063232:0@lo:503: 00000100:00100000:2.0:1787574197.364745:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574197.364760:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a26fc6480 going to sleep for 11 seconds 00000100:00100000:2.0:1787574197.364771:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290063232 00000100:00100000:2.0:1787574197.364775:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290063232 00000100:00100000:2.0:1787574197.364797:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787574197.364803:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04965c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+14:5827:x1874407290063232:12345-0@lo:503: 00000100:00100000:2.0:1787574197.368332:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04965c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+14:5827:x1874407290063232:12345-0@lo:503: Request processed in 3519us (3576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574197.368349:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787574197.368440:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290063232:0@lo:503: 00000100:00100000:2.0:1787574197.368650:0:8024:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8024:1874407290063360:0@lo:502: 00000100:00100000:2.0:1787574197.368707:0:8024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574197.368736:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290063360 00000100:00100000:2.0:1787574197.368745:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290063360 00000100:00100000:2.0:1787574197.368783:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787574197.368795:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04964050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+14:8024:x1874407290063360:12345-0@lo:502: 00000100:00100000:2.0:1787574197.369066:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04964050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+14:8024:x1874407290063360:12345-0@lo:502: Request processed in 274us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574197.369073:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787574197.369105:0:8024:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a07a09e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787574197.369116:0:8024:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8024:1874407290063360:0@lo:502: 00000100:00100000:2.0:1787574197.369154:0:8024:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8024:1874407290063488:0@lo:502: 00000100:00100000:2.0:1787574197.369207:0:8024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574197.369225:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290063488 00000100:00100000:2.0:1787574197.369228:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290063488 00000100:00100000:2.0:1787574197.369248:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787574197.369264:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04964850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+14:8024:x1874407290063488:12345-0@lo:502: 00000100:00100000:2.0:1787574197.369379:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04964850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+14:8024:x1874407290063488:12345-0@lo:502: Request processed in 116us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574197.369386:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787574197.369414:0:8024:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a07a09e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787574197.369425:0:8024:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8024:1874407290063488:0@lo:502: 00000040:00080000:2.0:1787574197.369442:0:8024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787574197.369495:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787574197.377344:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787574197.377375:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf6bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf6c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574197.377392:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf6bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf6c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574197.377403:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787574197.377406:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787574197.377410:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787574197.377469:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2aaa00/0xfe91058e646bf6cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574197.377478:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a1d2aaa00/0xfe91058e646bf6cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574197.377493:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a1d2aaa00/0xfe91058e646bf6cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574197.377526:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290063616:0@lo:101: 00000100:00100000:2.0:1787574197.377620:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574197.377750:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a07a09e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574197.384114:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290063616 00000100:00100000:0.0:1787574197.384133:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290063616 00000100:00100000:0.0:1787574197.384234:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787574197.384247:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+14:5827:x1874407290063616:12345-0@lo:101: 00010000:00010000:0.0:1787574197.384268:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574197.384290:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a00031e00/0xfe91058e646bf6d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf6cd expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574197.384325:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a00031e00/0xfe91058e646bf6d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf6cd expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574197.384337:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a00031e00/0xfe91058e646bf6d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf6cd expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574197.384349:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a00031e00, rc 0) 00000100:00100000:0.0:1787574197.384439:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+15:5827:x1874407290063616:12345-0@lo:101: Request processed in 194us (6819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574197.384447:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787574197.384530:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290063616:0@lo:101: 00010000:00010000:0.0:1787574197.384553:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a1d2aaa00/0xfe91058e646bf6cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf6d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574197.384564:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a1d2aaa00/0xfe91058e646bf6cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf6d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574197.384645:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290063744:0@lo:501: 00000100:00100000:0.0:1787574197.384686:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574197.384719:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3d01dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574197.384733:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290063744 00000100:00100000:0.0:1787574197.384750:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290063744 00000100:00100000:0.0:1787574197.384772:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787574197.384779:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+15:5827:x1874407290063744:12345-0@lo:501: 00000100:00100000:0.0:1787574197.385060:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+15:5827:x1874407290063744:12345-0@lo:501: Request processed in 280us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574197.385068:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787574197.385097:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290063744:0@lo:501: 00000100:00100000:0.0:1787574197.385122:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290063872:0@lo:503: 00000100:00100000:0.0:1787574197.385159:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574197.385197:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3d01dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574197.385208:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290063872 00000100:00100000:0.0:1787574197.385211:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290063872 00000100:00100000:0.0:1787574197.385230:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787574197.385235:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04966450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+15:5827:x1874407290063872:12345-0@lo:503: 00000100:00100000:0.0:1787574197.385529:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04966450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+15:5827:x1874407290063872:12345-0@lo:503: Request processed in 293us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574197.385537:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787574197.385573:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290063872:0@lo:503: 00000100:00100000:0.0:1787574197.385744:0:8026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8026:1874407290064000:0@lo:502: 00000100:00100000:0.0:1787574197.385777:0:8026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574197.385793:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290064000 00000100:00100000:0.0:1787574197.385796:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290064000 00000100:00100000:0.0:1787574197.385817:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787574197.385823:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04965050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+15:8026:x1874407290064000:12345-0@lo:502: 00000100:00100000:0.0:1787574197.385971:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04965050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+15:8026:x1874407290064000:12345-0@lo:502: Request processed in 148us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574197.385987:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787574197.386015:0:8026:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3d01d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787574197.386027:0:8026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8026:1874407290064000:0@lo:502: 00000020:01000000:0.0:1787574197.386049:0:8026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574197.386059:0:8026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574197.386061:0:8026:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787574197.386067:0:8026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787574197.386069:0:8026:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787574197.386083:0:8026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8026:1874407290064128:0@lo:502: 00000100:00100000:0.0:1787574197.386113:0:8026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574197.386130:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290064128 00000100:00100000:0.0:1787574197.386133:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290064128 00000100:00100000:0.0:1787574197.386151:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787574197.386156:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04964c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+15:8026:x1874407290064128:12345-0@lo:502: 00000100:00100000:0.0:1787574197.386277:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04964c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+15:8026:x1874407290064128:12345-0@lo:502: Request processed in 120us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574197.386283:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787574197.386307:0:8026:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0499acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574197.386317:0:8026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8026:1874407290064128:0@lo:502: 00000020:01000000:0.0:1787574197.386332:0:8026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574197.386336:0:8026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574197.386338:0:8026:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787574197.386342:0:8026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787574197.386394:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787574197.386408:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787574197.386421:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2aaa00/0xfe91058e646bf6cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf6d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574197.386443:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a1d2aaa00/0xfe91058e646bf6cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf6d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574197.386453:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787574197.386456:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982a0622a800 from 30 10000000:01000000:0.0:1787574197.386459:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787574197.386485:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf6db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574197.386492:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf6db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574197.386502:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf6db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574197.386513:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290064256:0@lo:101: 00000100:00100000:0.0:1787574197.386537:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574197.386550:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0499acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574197.386561:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290064256 00000100:00100000:0.0:1787574197.386564:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290064256 00000100:00100000:0.0:1787574197.386585:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787574197.386592:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04967850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+15:5827:x1874407290064256:12345-0@lo:101: 00010000:00010000:0.0:1787574197.386600:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574197.386612:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a00030a00/0xfe91058e646bf6e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf6db expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574197.386633:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a00030a00/0xfe91058e646bf6e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf6db expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574197.386657:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a00030a00/0xfe91058e646bf6e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf6db expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574197.386667:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a00030a00, rc 0) 00000100:00100000:0.0:1787574197.386695:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04967850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+16:5827:x1874407290064256:12345-0@lo:101: Request processed in 104us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574197.386701:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787574197.386732:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290064256:0@lo:101: 00010000:00010000:0.0:1787574197.386743:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf6db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf6e2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574197.386751:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf6db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf6e2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574197.386786:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290064384:0@lo:501: 00000100:00100000:0.0:1787574197.386809:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574197.386821:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0499acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574197.386844:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290064384 00000100:00100000:0.0:1787574197.386847:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290064384 00000100:00100000:0.0:1787574197.392654:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787574197.392680:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+16:5827:x1874407290064384:12345-0@lo:501: 00000100:00100000:0.0:1787574197.393068:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+16:5827:x1874407290064384:12345-0@lo:501: Request processed in 397us (6256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574197.394063:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290064384:0@lo:501: 00000100:00100000:3.0:1787574197.394136:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290064512:0@lo:503: 00000100:00100000:3.0:1787574197.394527:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574197.394565:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0805f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574197.394939:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290064512 00000100:00100000:3.0:1787574197.394949:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290064512 00000100:00100000:3.0:1787574197.394991:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787574197.395002:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290064512:12345-0@lo:503: 00000100:00100000:3.0:1787574197.395271:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290064512:12345-0@lo:503: Request processed in 269us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574197.395281:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787574197.397463:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290064512:0@lo:503: 00000100:00100000:0.0:1787574197.399570:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787574197.399971:0:8028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8028:1874407290064640:0@lo:502: 00000100:00100000:3.0:1787574197.400060:0:8028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574197.400110:0:8028:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0805fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787574197.400288:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290064640 00000100:00100000:2.0:1787574197.400298:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290064640 00000100:00100000:2.0:1787574197.400345:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787574197.400356:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+16:8028:x1874407290064640:12345-0@lo:502: 00000100:00100000:2.0:1787574197.400674:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+16:8028:x1874407290064640:12345-0@lo:502: Request processed in 319us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574197.400682:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787574197.400870:0:8028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8028:1874407290064640:0@lo:502: 00000100:00100000:3.0:1787574197.400927:0:8028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8028:1874407290064768:0@lo:502: 00000100:00100000:3.0:1787574197.400968:0:8028:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574197.401007:0:8028:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0805fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787574197.401051:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290064768 00000100:00100000:2.0:1787574197.401056:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290064768 00000100:00100000:2.0:1787574197.401090:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787574197.401098:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+16:8028:x1874407290064768:12345-0@lo:502: 00000100:00100000:2.0:1787574197.401272:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+16:8028:x1874407290064768:12345-0@lo:502: Request processed in 174us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574197.401278:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787574197.401313:0:8028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8028:1874407290064768:0@lo:502: 00000040:00080000:2.0:1787574197.401333:0:8028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787574197.401404:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787574197.401423:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787574197.401434:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf6db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf6e2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574197.401446:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf6db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf6e2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574197.401456:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787574197.401466:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff982a0622a800 from 5 10000000:01000000:2.0:1787574197.401469:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787574197.401499:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa000/0xfe91058e646bf6e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574197.401508:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa000/0xfe91058e646bf6e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574197.401519:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa000/0xfe91058e646bf6e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574197.401530:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290064896:0@lo:101: 00000100:00100000:2.0:1787574197.401558:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574197.401572:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a07df6000 going to sleep for 11 seconds 00000100:00100000:2.0:1787574197.401584:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290064896 00000100:00100000:2.0:1787574197.401588:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290064896 00000100:00100000:2.0:1787574197.401605:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787574197.401611:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+16:5827:x1874407290064896:12345-0@lo:101: 00010000:00010000:2.0:1787574197.401620:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574197.401634:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a1d2aa200/0xfe91058e646bf6f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf6e9 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574197.401657:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a1d2aa200/0xfe91058e646bf6f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf6e9 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574197.401668:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a1d2aa200/0xfe91058e646bf6f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf6e9 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574197.401679:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a1d2aa200, rc 0) 00000100:00100000:2.0:1787574197.401707:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290064896:12345-0@lo:101: Request processed in 97us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574197.401719:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787574197.401750:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290064896:0@lo:101: 00010000:00010000:2.0:1787574197.401762:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa000/0xfe91058e646bf6e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf6f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574197.401771:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa000/0xfe91058e646bf6e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf6f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574197.401816:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290065024:0@lo:256: 00000100:00100000:2.0:1787574197.401860:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574197.401873:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a07df6000 going to sleep for 11 seconds 00000100:00100000:2.0:1787574197.401885:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290065024 00000100:00100000:2.0:1787574197.401888:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290065024 00000100:00100000:2.0:1787574197.401905:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787574197.401911:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290065024:12345-0@lo:256: 20000000:01000000:2.0:1787574197.401925:0:5824:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787574197.401946:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787574197.401950:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787574197.402026:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290065024:12345-0@lo:256: Request processed in 115us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574197.402033:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787574197.402060:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290065024:0@lo:256: 10000000:01000000:2.0:1787574197.402102:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787574197.402107:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa000/0xfe91058e646bf6e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf6f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574197.402115:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa000/0xfe91058e646bf6e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf6f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574197.402128:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787574197.402129:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787574197.402131:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787574197.402148:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa600/0xfe91058e646bf6f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574197.402155:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa600/0xfe91058e646bf6f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574197.402186:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa600/0xfe91058e646bf6f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574197.402199:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290065152:0@lo:101: 00000100:00100000:2.0:1787574197.402224:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574197.402238:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a2e0fd240 going to sleep for 11 seconds 00000100:00100000:2.0:1787574197.402248:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290065152 00000100:00100000:2.0:1787574197.402252:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290065152 00000100:00100000:2.0:1787574197.402270:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787574197.402275:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290065152:12345-0@lo:101: 00010000:00010000:2.0:1787574197.402283:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574197.402291:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a1d2abe00/0xfe91058e646bf6fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf6f7 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574197.402305:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a1d2abe00/0xfe91058e646bf6fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf6f7 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574197.402313:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a1d2abe00/0xfe91058e646bf6fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf6f7 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574197.402331:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a1d2abe00, rc 0) 00000100:00100000:2.0:1787574197.402360:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290065152:12345-0@lo:101: Request processed in 84us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574197.402365:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787574197.402393:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290065152:0@lo:101: 00010000:00010000:2.0:1787574197.402402:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa600/0xfe91058e646bf6f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf6fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574197.402410:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa600/0xfe91058e646bf6f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf6fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574197.402454:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290065280:0@lo:501: 00000100:00100000:2.0:1787574197.402479:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574197.402490:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a2e0fd240 going to sleep for 11 seconds 00000100:00100000:2.0:1787574197.402501:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290065280 00000100:00100000:2.0:1787574197.402504:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290065280 00000100:00100000:2.0:1787574197.402520:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787574197.402526:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290065280:12345-0@lo:501: 00000100:00100000:2.0:1787574197.402785:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290065280:12345-0@lo:501: Request processed in 258us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574197.402792:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787574197.402820:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290065280:0@lo:501: 00000100:00100000:2.0:1787574197.402860:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290065408:0@lo:503: 00000100:00100000:2.0:1787574197.402899:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574197.402913:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a03752cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574197.402928:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290065408 00000100:00100000:2.0:1787574197.402932:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290065408 00000100:00100000:2.0:1787574197.402948:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787574197.402953:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290065408:12345-0@lo:503: 00000100:00100000:2.0:1787574197.403266:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290065408:12345-0@lo:503: Request processed in 311us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574197.403273:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787574197.403310:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290065408:0@lo:503: 00000100:00100000:0.0:1787574197.403874:0:8029:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8029:1874407290065536:0@lo:502: 00000100:00100000:0.0:1787574197.403921:0:8029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574197.403953:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290065536 00000100:00100000:0.0:1787574197.403957:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290065536 00000100:00100000:0.0:1787574197.403989:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787574197.403998:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:8029:x1874407290065536:12345-0@lo:502: 00000100:00100000:0.0:1787574197.404275:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:8029:x1874407290065536:12345-0@lo:502: Request processed in 277us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574197.404283:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787574197.404321:0:8029:0:(client.c:2715:ptlrpc_set_wait()) set ffff9829047a0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574197.404336:0:8029:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8029:1874407290065536:0@lo:502: 00000020:01000000:0.0:1787574197.404361:0:8029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787574197.404435:0:8029:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787574197.404443:0:8029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574197.404445:0:8029:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787574197.404452:0:8029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787574197.404456:0:8029:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:0.0:1787574197.404481:0:8029:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787574197.404484:0:8029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787574197.404500:0:8029:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff982904c7cd28) 00000020:00000080:0.0:1787574197.404528:0:8029:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787574197.404535:0:8029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787574197.404628:0:8029:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787574197.404635:0:8029:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787574197.404642:0:8029:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfe91058e646bf70c 00010000:00080000:0.0:1787574197.404679:0:8029:0:(ldlm_lib.c:102:import_set_conn()) imp ffff982a0786f800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:0.0:1787574197.404957:0:8029:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1787574197.405323:0:8029:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787574197.405335:0:8029:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787574197.408097:0:8029:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787574197.413771:0:8029:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787574197.413864:0:8029:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787574197.413942:0:8029:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787574197.414813:0:8031:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787574197.414819:0:8031:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787574197.415548:0:8029:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787574197.415562:0:8029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787574197.415603:0:8029:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787574197.415627:0:8029:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfe91058e646bf713 00000100:00080000:0.0:1787574197.415639:0:8029:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787574197.415645:0:8029:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff982a0786f800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1787574197.415692:0:8029:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982a41f6fb80 x1874407290065664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787574197.415717:0:8029:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787574197.415769:0:8029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574197.415773:0:8029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574197.415775:0:8029:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787574197.415777:0:8029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574197.415780:0:8029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574197.415782:0:8029:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787574197.415784:0:8029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787574197.415786:0:8029:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787574197.415817:0:8029:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8029:1874407290065792:0@lo:502: 00000100:00100000:0.0:1787574197.415918:0:8029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574197.415963:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290065792 00000100:00100000:0.0:1787574197.415970:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290065792 00000100:00100000:0.0:1787574197.416013:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787574197.416023:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:8029:x1874407290065792:12345-0@lo:502: 00000100:00100000:0.0:1787574197.416298:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:8029:x1874407290065792:12345-0@lo:502: Request processed in 275us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574197.416314:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787574197.416377:0:8029:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3d01d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787574197.416402:0:8029:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8029:1874407290065792:0@lo:502: 00000020:01000000:0.0:1787574197.416433:0:8029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574197.416437:0:8029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574197.416439:0:8029:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787574197.416442:0:8029:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1787574197.416490:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00000100:00100000:2.0:1787574197.417325:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290065920:0@lo:400: 00000100:00100000:2.0:1787574197.417384:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574197.417420:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787574197.417426:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874407290066304:0@lo:400: 00000100:00100000:2.0:1787574197.417456:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574197.417488:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290066048:0@lo:400: 00000100:00100000:2.0:1787574197.417530:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574197.417553:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574197.417558:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290066176:0@lo:400: 00000100:00100000:2.0:1787574197.417583:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574197.417616:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290065920 00000100:00100000:2.0:1787574197.417622:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290065920 00000100:00100000:2.0:1787574197.417666:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290066304 00000100:00100000:2.0:1787574197.417669:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290066304 00000100:00100000:2.0:1787574197.417690:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290066048 00000100:00100000:2.0:1787574197.417693:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290066048 00000100:00100000:2.0:1787574197.417708:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574197.417715:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290065920:12345-0@lo:400: 00000100:00100000:2.0:1787574197.417765:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290065920:12345-0@lo:400: Request processed in 50us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574197.417779:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574197.417794:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787574197.417800:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874407290066304:12345-0@lo:400: 00000100:00100000:2.0:1787574197.417827:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874407290066304:12345-0@lo:400: Request processed in 28us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574197.417846:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787574197.417857:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787574197.417863:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290066048:12345-0@lo:400: 00000100:00100000:2.0:1787574197.417892:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290066048:12345-0@lo:400: Request processed in 30us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574197.417897:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787574197.417924:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290066176 00000100:00100000:2.0:1787574197.417928:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290066176 00000100:00100000:2.0:1787574197.417953:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787574197.417959:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290066176:12345-0@lo:400: 00000100:00100000:2.0:1787574197.417988:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290066176:12345-0@lo:400: Request processed in 30us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574197.417993:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787574197.418013:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574197.418018:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787574197.418042:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a0355c700 x1874407290066176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574197.418057:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290066176:0@lo:400: 00010000:00080000:2.0:1787574197.418068:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a0355e300 x1874407290066048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574197.418088:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290066048:0@lo:400: 00010000:00080000:2.0:1787574197.418118:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a0355f800 x1874407290066304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574197.418127:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874407290066304:0@lo:400: 00010000:00080000:2.0:1787574197.418136:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a0355e680 x1874407290065920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574197.418143:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290065920:0@lo:400: 00000100:00100000:1.0:1787574197.419140:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874407290065664:0@lo:8: 00000100:00100000:1.0:1787574197.419230:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1787574197.421282:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787574197.421303:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa600/0xfe91058e646bf6f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf6fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574197.421318:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa600/0xfe91058e646bf6f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf6fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574197.421329:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787574197.421332:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff982a0488b370 from 1 10000000:01000000:0.0:1787574197.421335:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787574197.421379:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf71a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574197.421388:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf71a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574197.421401:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf71a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574197.421427:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290066432:0@lo:101: 00000100:00100000:0.0:1787574197.421494:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574197.422055:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3d01d180 going to sleep for 11 seconds 00000100:00100000:2.0:1787574197.422153:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290065664 00000100:00100000:2.0:1787574197.422185:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290065664 00000100:00100000:2.0:1787574197.422230:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787574197.422240:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3297:x1874407290065664:12345-0@lo:8: 00010000:00080000:2.0:1787574197.422276:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:2.0:1787574197.422306:0:6683:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfe91058e646bf721 00002000:00100000:2.0:1787574197.422322:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff982a41928000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787574197.422327:0:6683:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787574197.422331:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787574197.422473:0:6683:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787574197.424425:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787574197.424469:0:6683:0:(import.c:65:import_set_state_nolock()) ffff982a4192e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574197.424601:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3297:x1874407290065664:12345-0@lo:8: Request processed in 2358us (5367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574197.424615:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787574197.426765:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41f6fb80 x1874407290065664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787574207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574197.426782:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787574197.426810:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787574197.426935:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787574197.426943:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787574197.426948:0:3297:0:(import.c:65:import_set_state_nolock()) ffff982a0786f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787574197.426971:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787574197.426979:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874407290065664:0@lo:8: 00000004:00080000:0.0:1787574197.427289:0:8031:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787574197.427400:0:8031:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 173602233344ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787574197.428020:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290066432 00000100:00100000:1.0:1787574197.428033:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290066432 00000100:00100000:1.0:1787574197.430525:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787574197.430541:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290066432:12345-0@lo:101: 00010000:00010000:1.0:1787574197.430563:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574197.430584:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a42045800/0xfe91058e646bf728 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf71a expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574197.430619:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a42045800/0xfe91058e646bf728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf71a expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574197.430630:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a42045800/0xfe91058e646bf728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf71a expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574197.430650:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a42045800, rc 0) 00000100:00100000:1.0:1787574197.430735:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290066432:12345-0@lo:101: Request processed in 198us (9241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574197.430742:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787574197.436104:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290066432:0@lo:101: 00010000:00010000:3.0:1787574197.436142:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf71a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf728 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574197.436158:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf71a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf728 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574197.436408:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290066560:0@lo:501: 00000100:00100000:3.0:1787574197.436482:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574197.436547:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0805f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787574197.438847:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290066560 00000100:00100000:0.0:1787574197.438864:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290066560 00000100:00100000:0.0:1787574197.438966:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787574197.438979:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290066560:12345-0@lo:501: 00000100:00100000:0.0:1787574197.439352:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290066560:12345-0@lo:501: Request processed in 374us (2869us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787574197.439362:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787574197.440851:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290066560:0@lo:501: 10000000:01000000:3.0:1787574197.440906:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787574197.440919:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf71a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf728 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574197.440932:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf71a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf728 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787574197.502149:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1787574197.504307:0:8032:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787574197.504417:0:8032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8032:1874407290066816:0@lo:7: 00000100:00100000:2.0:1787574197.504521:0:8032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574197.504558:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290066688:0@lo:13: 00000100:00100000:2.0:1787574197.504584:0:8032:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a07d7b180 going to sleep for 11 seconds 00000100:00100000:3.0:1787574197.504607:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574197.504619:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290066816 00000100:00100000:2.0:1787574197.504628:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290066816 00000100:00080000:3.0:1787574197.504671:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574197.504724:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787574197.504736:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8032:x1874407290066816:12345-0@lo:7: 00000100:00100000:1.0:1787574197.507694:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290066688 00000100:00100000:1.0:1787574197.507710:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290066688 00000100:00100000:1.0:1787574197.507791:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787574197.507806:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1874407290066688:12345-0@lo:13: 00002000:00000024:1.0:1787574197.507855:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787574197.507964:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1874407290066688:12345-0@lo:13: Request processed in 163us (3357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574197.507973:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787574197.508018:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419daa00 x1874407290066688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574197.508045:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290066688:0@lo:13: 00002000:00080000:3.0:1787574197.515532:0:6681:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1787574197.515542:0:6681:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787574197.515657:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8032:x1874407290066816:12345-0@lo:7: Request processed in 10917us (11131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574197.515670:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787574197.515707:0:8032:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419d8a80 x1874407290066816/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787574213 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574197.515728:0:8032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8032:1874407290066816:0@lo:7: 00000004:00080000:0.0:1787574197.515745:0:8032:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787574197.515794:0:8032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8032:1874407290066944:0@lo:5: 00000100:00100000:0.0:1787574197.515847:0:8032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574197.515884:0:8032:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0576fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574197.515902:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290066944 00000100:00100000:0.0:1787574197.515910:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290066944 00000100:00100000:0.0:1787574197.515967:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787574197.515978:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8032:x1874407290066944:12345-0@lo:5: 00002000:00080000:0.0:1787574197.516008:0:6682:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787574197.516013:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787574197.516326:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8032:x1874407290066944:12345-0@lo:5: Request processed in 349us (478us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787574197.516334:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787574197.516360:0:8032:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41f6ed80 x1874407290066944/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787574213 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574197.516386:0:8032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8032:1874407290066944:0@lo:5: 00000004:00080000:0.0:1787574197.516396:0:8032:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787574197.516424:0:8032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8032:1874407290067072:0@lo:700: 00000100:00100000:0.0:1787574197.516450:0:8032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574197.517754:0:8032:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0576fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574197.517781:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290067072 00000100:00100000:0.0:1787574197.517787:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290067072 00000100:00100000:0.0:1787574197.517873:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574197.517883:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8032:x1874407290067072:12345-0@lo:700: 00000100:00100000:0.0:1787574197.517925:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6690:1874407290067200:0@lo:700: 00000100:00100000:0.0:1787574197.517983:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574197.518004:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0576f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574197.518025:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290067200 00000100:00100000:0.0:1787574197.518028:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290067200 00000100:00100000:0.0:1787574197.518067:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574197.518074:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6690:x1874407290067200:12345-0@lo:700: 40000000:02000000:0.0:1787574197.599427:0:5837:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1787574197.606067:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6690:x1874407290067200:12345-0@lo:700: Request processed in 87982us (88072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574197.606090:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787574197.606216:0:6690:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41f6fb80 x1874407290067200/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787574213 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574197.606234:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6690:1874407290067200:0@lo:700: 40000000:02000000:0.0:1787574197.606249:0:6690:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1787574197.722675:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1787574197.722707:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787574197.724892:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8032:x1874407290067072:12345-0@lo:700: Request processed in 206999us (208429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574197.724909:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787574197.725085:0:8032:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41f6e680 x1874407290067072/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787574213 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574197.725117:0:8032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8032:1874407290067072:0@lo:700: 00000004:02000040:0.0:1787574197.773431:0:8032:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1787574197.778303:0:8032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a2ff01880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8032:1874407290067328:0@lo:5: 00000100:00100000:0.0:1787574197.778385:0:8032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574197.778447:0:8032:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0dd523c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574197.779496:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290067328 00000100:00100000:3.0:1787574197.779507:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290067328 00000100:00100000:3.0:1787574197.779579:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787574197.779591:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8032:x1874407290067328:12345-0@lo:5: 00002000:00080000:3.0:1787574197.815937:0:6681:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787574197.815970:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1787574197.832794:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8032:x1874407290067328:12345-0@lo:5: Request processed in 53193us (54397us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787574197.832810:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787574197.832889:0:8032:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a2ff01880 x1874407290067328/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787574213 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574197.832904:0:8032:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787574197.832921:0:8032:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff982a2ff01880 x1874407290067328/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787574213 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574197.832934:0:8032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a2ff01880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8032:1874407290067328:0@lo:5: 00000004:00080000:2.0:1787574197.832952:0:8032:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1787574198.004935:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574198.897492:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574198.901416:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290067456:0@lo:13: 00000100:00100000:3.0:1787574198.901517:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574198.905124:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290067456 00000100:00100000:2.0:1787574198.905145:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290067456 00000100:00100000:2.0:1787574198.906214:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787574198.906234:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290067456:12345-0@lo:13: 00002000:00000024:2.0:1787574198.906294:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787574198.906400:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290067456:12345-0@lo:13: Request processed in 174us (4882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574198.906428:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787574198.906524:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419dbb80 x1874407290067456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574198.906550:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290067456:0@lo:13: 00010000:00010000:0.0:1787574199.025834:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574200.058045:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574201.074089:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787574201.520542:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1787574201.981961:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574201.984596:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272218752 00000100:00100000:1.0:1787574201.984613:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272218752 00000100:00100000:1.0:1787574201.985642:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:1.0:1787574201.985654:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2349:x1874407272218752:12345-192.168.206.51@tcp:250: 00010000:00080000:1.0:1787574201.985687:0:5824:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c9891405-66e8-4ae2-851e-6434ae47d085@192.168.206.51@tcp t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:1.0:1787574201.985720:0:5824:0:(genops.c:1385:class_connect()) connect: client c9891405-66e8-4ae2-851e-6434ae47d085, cookie 0xfe91058e646bf72f 00000100:00080000:1.0:1787574201.985876:0:5824:0:(import.c:65:import_set_state_nolock()) ffff982906b89800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787574201.985972:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+5:2349:x1874407272218752:12345-192.168.206.51@tcp:250: Request processed in 317us (4021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574201.985995:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:3.0:1787574201.997472:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574201.997567:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272218880 00000100:00100000:0.0:1787574201.997578:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272218880 00000100:00100000:0.0:1787574201.997640:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:0.0:1787574201.997650:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+5:5577:x1874407272218880:12345-192.168.206.51@tcp:101: 00010000:00010000:0.0:1787574201.997668:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574201.997687:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a00031400/0xfe91058e646bf736 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1e9ef expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574201.997716:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a00031400/0xfe91058e646bf736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1e9ef expref: 6 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574201.997728:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a00031400/0xfe91058e646bf736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1e9ef expref: 6 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574201.997737:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a00031400, rc 0) 00000100:00100000:0.0:1787574201.997815:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+6:5577:x1874407272218880:12345-192.168.206.51@tcp:101: Request processed in 157us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574201.997823:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:0.0:1787574201.999911:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574202.000019:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272219008 00000100:00100000:2.0:1787574202.000029:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272219008 00000100:00100000:2.0:1787574202.000084:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:2.0:1787574202.000094:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+6:5577:x1874407272219008:12345-192.168.206.51@tcp:501: 00000100:00100000:2.0:1787574202.000662:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+6:5577:x1874407272219008:12345-192.168.206.51@tcp:501: Request processed in 566us (759us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787574202.000672:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:2.0:1787574202.008117:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574202.011662:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272219136 00000100:00100000:3.0:1787574202.011679:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272219136 00000100:00100000:3.0:1787574202.011784:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:3.0:1787574202.011795:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+6:5577:x1874407272219136:12345-192.168.206.51@tcp:101: 00010000:00010000:3.0:1787574202.011820:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574202.011854:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a027f2c00/0xfe91058e646bf73d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1e9f6 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574202.011886:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a027f2c00/0xfe91058e646bf73d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1e9f6 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574202.011899:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a027f2c00/0xfe91058e646bf73d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1e9f6 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574202.011909:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a027f2c00, rc 0) 00000100:00100000:3.0:1787574202.012256:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+7:5577:x1874407272219136:12345-192.168.206.51@tcp:101: Request processed in 461us (4151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574202.012264:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:1.0:1787574202.017427:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574202.017579:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272219264 00000100:00100000:3.0:1787574202.017591:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272219264 00000100:00100000:3.0:1787574202.017639:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:3.0:1787574202.017649:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a10091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+7:5577:x1874407272219264:12345-192.168.206.51@tcp:501: 00000100:00100000:0.0:1787574202.023425:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a10091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+8:5577:x1874407272219264:12345-192.168.206.51@tcp:501: Request processed in 5765us (5997us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574202.023440:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:2.0:1787574202.026297:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574202.026550:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272219392 00000100:00100000:3.0:1787574202.026561:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272219392 00000100:00100000:3.0:1787574202.026621:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:3.0:1787574202.026630:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a10093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+8:5577:x1874407272219392:12345-192.168.206.51@tcp:503: 00000100:00100000:3.0:1787574202.027082:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a10093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+8:5577:x1874407272219392:12345-192.168.206.51@tcp:503: Request processed in 451us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574202.027091:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:2.0:1787574202.036441:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574202.036619:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272219520 00000100:00100000:0.0:1787574202.036629:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272219520 00000100:00100000:0.0:1787574202.036684:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:0.0:1787574202.036694:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a10093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+8:5595:x1874407272219520:12345-192.168.206.51@tcp:502: 00000100:00100000:0.0:1787574202.037071:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a10093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+8:5595:x1874407272219520:12345-192.168.206.51@tcp:502: Request processed in 377us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574202.037080:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:3.0:1787574202.089222:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574202.089514:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272219648 00000100:00100000:0.0:1787574202.089523:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272219648 00000100:00100000:0.0:1787574202.089575:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:0.0:1787574202.089583:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+8:5595:x1874407272219648:12345-192.168.206.51@tcp:502: 00000100:00100000:0.0:1787574202.090232:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+8:5595:x1874407272219648:12345-192.168.206.51@tcp:502: Request processed in 645us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574202.090242:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 118 00010000:00010000:3.0:1787574202.099403:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574202.115141:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574202.115237:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272219776 00000100:00100000:3.0:1787574202.115247:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272219776 00000100:00100000:3.0:1787574202.115318:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:3.0:1787574202.115328:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+8:5577:x1874407272219776:12345-192.168.206.51@tcp:101: 00010000:00010000:3.0:1787574202.115345:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574202.115364:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a027f3800/0xfe91058e646bf744 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ea20 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574202.115391:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a027f3800/0xfe91058e646bf744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea20 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574202.115402:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a027f3800/0xfe91058e646bf744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea20 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574202.115411:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a027f3800, rc 0) 00000100:00100000:3.0:1787574202.115479:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+9:5577:x1874407272219776:12345-192.168.206.51@tcp:101: Request processed in 143us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574202.115487:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:1.0:1787574202.123895:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574202.124069:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272219904 00000100:00100000:2.0:1787574202.124079:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272219904 00000100:00100000:2.0:1787574202.124132:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:2.0:1787574202.124143:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+9:5577:x1874407272219904:12345-192.168.206.51@tcp:256: 20000000:01000000:2.0:1787574202.124198:0:5823:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787574202.124224:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787574202.124229:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787574202.124232:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787574202.124235:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787574202.129418:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+9:5577:x1874407272219904:12345-192.168.206.51@tcp:256: Request processed in 5264us (5519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574202.129434:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:1.0:1787574202.134677:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574202.137036:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272220032 00000100:00100000:2.0:1787574202.137048:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272220032 00000100:00100000:2.0:1787574202.137111:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:2.0:1787574202.137120:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+9:5577:x1874407272220032:12345-192.168.206.51@tcp:101: 00010000:00010000:2.0:1787574202.137146:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574202.139814:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a1d2abc00/0xfe91058e646bf74b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ea27 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574202.140059:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a1d2abc00/0xfe91058e646bf74b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea27 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574202.140078:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a1d2abc00/0xfe91058e646bf74b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea27 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574202.140088:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a1d2abc00, rc 0) 00000100:00100000:2.0:1787574202.140157:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+10:5577:x1874407272220032:12345-192.168.206.51@tcp:101: Request processed in 3036us (5489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574202.140180:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:2.0:1787574202.152074:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574202.152120:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272220160 00000100:00100000:2.0:1787574202.152128:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272220160 00000100:00100000:2.0:1787574202.152188:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 122 00000100:00100000:2.0:1787574202.152203:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+10:5577:x1874407272220160:12345-192.168.206.51@tcp:501: 00000100:00100000:2.0:1787574202.152472:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+10:5577:x1874407272220160:12345-192.168.206.51@tcp:501: Request processed in 275us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574202.160095:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 122 00000100:00100000:1.0:1787574202.160970:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574202.161057:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272220288 00000100:00100000:3.0:1787574202.161065:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272220288 00000100:00100000:3.0:1787574202.161117:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:3.0:1787574202.161127:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+10:5577:x1874407272220288:12345-192.168.206.51@tcp:503: 00000100:00100000:3.0:1787574202.161927:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+10:5577:x1874407272220288:12345-192.168.206.51@tcp:503: Request processed in 798us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574202.161937:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:0.0:1787574202.178071:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574202.178239:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272220416 00000100:00100000:2.0:1787574202.178250:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272220416 00000100:00100000:3.0:1787574202.178540:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 124 00000100:00100000:3.0:1787574202.178550:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+10:5599:x1874407272220416:12345-192.168.206.51@tcp:502: 00000100:00100000:3.0:1787574202.178856:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+10:5599:x1874407272220416:12345-192.168.206.51@tcp:502: Request processed in 306us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574202.178875:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 124 00000100:00100000:3.0:1787574202.181863:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574202.181959:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272220544 00000100:00100000:0.0:1787574202.181968:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272220544 00000100:00100000:0.0:1787574202.182021:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00100000:0.0:1787574202.182031:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+10:5599:x1874407272220544:12345-192.168.206.51@tcp:502: 00000100:00100000:0.0:1787574202.182288:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+10:5599:x1874407272220544:12345-192.168.206.51@tcp:502: Request processed in 250us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574202.182297:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00100000:2.0:1787574202.184596:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574202.184685:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272220672 00000100:00100000:3.0:1787574202.184694:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272220672 00000100:00100000:3.0:1787574202.184739:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:3.0:1787574202.184748:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2349:x1874407272220672:12345-192.168.206.51@tcp:38: 00010000:00080000:3.0:1787574202.184774:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:3.0:1787574202.184833:0:5832:0:(genops.c:1385:class_connect()) connect: client a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f, cookie 0xfe91058e646bf752 00000004:00100000:3.0:1787574202.184862:0:5832:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787574202.184868:0:5832:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787574202.229643:0:5832:0:(import.c:65:import_set_state_nolock()) ffff982a4192a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574202.229722:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2349:x1874407272220672:12345-192.168.206.51@tcp:38: Request processed in 44973us (45133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574202.229748:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1787574202.482209:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290067712:0@lo:400: 00000100:00100000:1.0:1787574202.482288:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574202.482360:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290068224:0@lo:400: 00000100:00100000:1.0:1787574202.482396:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574202.482431:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574202.482437:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290067840:0@lo:400: 00000100:00100000:1.0:1787574202.482457:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574202.482500:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290068224 00000100:00100000:1.0:1787574202.482507:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290068224 00000100:00100000:1.0:1787574202.482562:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787574202.482571:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290068224:12345-0@lo:400: 00000100:00100000:1.0:1787574202.482615:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290068224:12345-0@lo:400: Request processed in 46us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574202.482622:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787574202.482644:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290067712 00000100:00100000:1.0:1787574202.482648:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290067712 00000100:00100000:1.0:1787574202.482669:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290067840 00000100:00100000:1.0:1787574202.482671:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290067840 00000100:00100000:1.0:1787574202.482690:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787574202.482696:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290067712:12345-0@lo:400: 00000100:00100000:1.0:1787574202.482738:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290067712:12345-0@lo:400: Request processed in 42us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574202.482756:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787574202.482769:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787574202.482774:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290067840:12345-0@lo:400: 00000100:00100000:1.0:1787574202.482800:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290067840:12345-0@lo:400: Request processed in 26us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574202.482817:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1787574202.482833:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787574202.482836:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787574202.483124:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290067968:0@lo:400: 00000100:00100000:0.0:1787574202.483158:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574202.483206:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787574202.483213:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290067584:0@lo:400: 00000100:00100000:0.0:1787574202.483239:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574202.483262:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874407290068096:0@lo:400: 00000100:00100000:0.0:1787574202.483283:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574202.483312:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290067968 00000100:00100000:0.0:1787574202.483316:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290067968 00000100:00100000:0.0:1787574202.483347:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787574202.483354:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290067968:12345-0@lo:400: 00000100:00100000:0.0:1787574202.483407:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290067968:12345-0@lo:400: Request processed in 55us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574202.483414:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787574202.483430:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290067584 00000100:00100000:0.0:1787574202.483433:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290067584 00000100:00100000:0.0:1787574202.483451:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787574202.483456:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:3300:x1874407290067584:12345-0@lo:400: 00000100:00100000:0.0:1787574202.483539:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:3300:x1874407290067584:12345-0@lo:400: Request processed in 82us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574202.483545:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787574202.483578:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290067584:0@lo:400: 00010000:00080000:0.0:1787574202.483590:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419db800 x1874407290067968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574202.483600:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290067968:0@lo:400: 00000100:00080000:0.0:1787574202.483636:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787574202.483698:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419d9180 x1874407290067840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574202.483707:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290067840:0@lo:400: 00000100:00100000:0.0:1787574202.483786:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290068096 00000100:00100000:0.0:1787574202.483790:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290068096 00000100:00100000:0.0:1787574202.483825:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787574202.483830:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874407290068096:12345-0@lo:400: 00000100:00100000:0.0:1787574202.483858:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874407290068096:12345-0@lo:400: Request processed in 28us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574202.483863:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1787574202.483873:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787574202.483885:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419d9880 x1874407290068096/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574202.483894:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874407290068096:0@lo:400: 00010000:00080000:1.0:1787574202.483956:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419d9f80 x1874407290067712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574202.484038:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290067712:0@lo:400: 00010000:00080000:1.0:1787574202.484131:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419db100 x1874407290068224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574202.484139:0:3298:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787574202.484149:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290068224:0@lo:400: 00000100:00100000:3.0:1787574202.993771:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290068352:0@lo:13: 00000100:00100000:3.0:1787574202.993855:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574202.994120:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290068352 00000100:00100000:0.0:1787574202.994129:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290068352 00000100:00100000:0.0:1787574202.994208:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787574202.994218:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290068352:12345-0@lo:13: 00002000:00000024:0.0:1787574202.994251:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574202.994306:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290068352:12345-0@lo:13: Request processed in 89us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574202.994313:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787574202.994474:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419d9c00 x1874407290068352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574202.994492:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290068352:0@lo:13: 00010000:00010000:1.0:1787574203.121355:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574203.241975:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574203.242034:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574203.242124:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272220928 00000100:00100000:3.0:1787574203.242138:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272220928 00000100:00100000:3.0:1787574203.242248:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272220800 00000100:00100000:3.0:1787574203.242252:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272220800 00000100:00100000:3.0:1787574203.242298:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:3.0:1787574203.242311:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:5577:x1874407272220928:12345-192.168.206.51@tcp:41: 00000004:00000024:3.0:1787574203.242367:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787574203.242450:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:5577:x1874407272220928:12345-192.168.206.51@tcp:41: Request processed in 141us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574203.242458:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:3.0:1787574203.242506:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:3.0:1787574203.242513:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:0:x1874407272220800:12345-192.168.206.51@tcp:41: 00000004:00000024:3.0:1787574203.242525:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787574203.242549:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:0:x1874407272220800:12345-192.168.206.51@tcp:41: Request processed in 37us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574203.242556:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00080000:2.0:1787574203.242899:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574203.247091:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574203.247207:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272221056 00000100:00100000:3.0:1787574203.247220:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272221056 00000100:00100000:3.0:1787574203.247309:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:3.0:1787574203.247321:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:5577:x1874407272221056:12345-192.168.206.51@tcp:40: 00000100:00100000:3.0:1787574203.247435:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:5577:x1874407272221056:12345-192.168.206.51@tcp:40: Request processed in 116us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574203.247444:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:2.0:1787574203.256124:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574203.257256:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272221184 00000100:00100000:1.0:1787574203.257275:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272221184 00000100:00100000:1.0:1787574203.257345:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:1.0:1787574203.257356:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1874407272221184:12345-192.168.206.51@tcp:8: 00010000:00080000:1.0:1787574203.257395:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:1.0:1787574203.257455:0:6683:0:(genops.c:1385:class_connect()) connect: client a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f, cookie 0xfe91058e646bf759 00002000:00100000:1.0:1787574203.257479:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f/ffff982906b8d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787574203.257516:0:6683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787574203.257945:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787574203.257985:0:6683:0:(import.c:65:import_set_state_nolock()) ffff982906b88800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787574203.258078:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2349:x1874407272221184:12345-192.168.206.51@tcp:8: Request processed in 723us (1967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574203.258088:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1787574203.258393:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574203.259021:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272221440 00000100:00100000:1.0:1787574203.259032:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272221440 00000100:00100000:1.0:1787574203.259129:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 127 00000100:00100000:1.0:1787574203.259140:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+10:2352:x1874407272221440:12345-192.168.206.51@tcp:400: 00000100:00100000:1.0:1787574203.259234:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+10:2352:x1874407272221440:12345-192.168.206.51@tcp:400: Request processed in 96us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574203.259242:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 127 00000100:00100000:3.0:1787574203.262656:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574203.262708:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574203.262873:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272221312 00000100:00100000:0.0:1787574203.262886:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272221312 00000100:00100000:0.0:1787574203.262943:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:0.0:1787574203.262953:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1874407272221312:12345-192.168.206.51@tcp:8: 00010000:00080000:0.0:1787574203.262993:0:6682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:0.0:1787574203.263026:0:6682:0:(genops.c:1385:class_connect()) connect: client a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f, cookie 0xfe91058e646bf760 00002000:00100000:0.0:1787574203.263041:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f/ffff982a0786e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787574203.263070:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787574203.263548:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787574203.263586:0:6682:0:(import.c:65:import_set_state_nolock()) ffff982a07868000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574203.263665:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2349:x1874407272221312:12345-192.168.206.51@tcp:8: Request processed in 711us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574203.263673:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:1.0:1787574203.264141:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272221568 00000100:00100000:1.0:1787574203.264150:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272221568 00000100:00100000:1.0:1787574203.264234:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:1.0:1787574203.264245:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:5577:x1874407272221568:12345-192.168.206.51@tcp:33: 00000004:00080000:0.0:1787574203.284020:0:5833:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 19688us 00000004:00200000:0.0:1787574203.295637:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787574203.295848:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:5577:x1874407272221568:12345-192.168.206.51@tcp:33: Request processed in 31597us (33130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574203.295867:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1787574203.520862:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574203.521200:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272221696 00000100:00100000:0.0:1787574203.521213:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272221696 00000100:00100000:0.0:1787574203.521296:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:0.0:1787574203.521313:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:5616:x1874407272221696:12345-192.168.206.51@tcp:101: 00010000:00010000:0.0:1787574203.521341:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574203.521376:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030800/0xfe91058e646bf767 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ea51 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574203.521582:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bf76e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574203.521599:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bf76e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574203.521617:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bf76e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574203.521873:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787574203.521878:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787574203.521959:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bf76e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574203.522569:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030800/0xfe91058e646bf767 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea51 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574203.522597:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bf76e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea51 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574203.522606:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a0de1db00) 00010000:00010000:0.0:1787574203.522609:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787574203.522613:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a00030400, rc 0) 00000100:00100000:0.0:1787574203.523072:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:5616:x1874407272221696:12345-192.168.206.51@tcp:101: Request processed in 1763us (2224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574203.523082:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:0.0:1787574204.019960:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290068480:0@lo:13: 00000100:00100000:0.0:1787574204.020049:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574204.020286:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290068480 00000100:00100000:2.0:1787574204.020298:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290068480 00000100:00100000:2.0:1787574204.020378:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787574204.020391:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290068480:12345-0@lo:13: 00002000:00000024:2.0:1787574204.020419:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787574204.020476:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290068480:12345-0@lo:13: Request processed in 88us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574204.020483:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787574204.022623:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787574204.022701:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419dad80 x1874407290068480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574204.022739:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290068480:0@lo:13: 00010000:00010000:3.0:1787574204.145533:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787574205.103229:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f 00010000:00010000:1.0:1787574205.169386:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574205.536677:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574205.536803:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272221824 00000100:00100000:0.0:1787574205.536813:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272221824 00000100:00100000:0.0:1787574205.536970:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:0.0:1787574205.536981:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:5668:x1874407272221824:12345-192.168.206.51@tcp:41: 00000004:00000024:0.0:1787574205.537021:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787574205.537105:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:5668:x1874407272221824:12345-192.168.206.51@tcp:41: Request processed in 126us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574205.537113:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00080000:2.0:1787574205.541322:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574205.542774:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574205.542884:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272221952 00000100:00100000:0.0:1787574205.542893:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272221952 00000100:00100000:0.0:1787574205.543011:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:0.0:1787574205.543023:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:5668:x1874407272221952:12345-192.168.206.51@tcp:13: 00002000:00000024:0.0:1787574205.543059:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574205.543150:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:5668:x1874407272221952:12345-192.168.206.51@tcp:13: Request processed in 129us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574205.543157:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1787574205.546146:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574205.546428:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272222080 00000100:00100000:0.0:1787574205.546437:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272222080 00000100:00080000:2.0:1787574205.547254:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787574205.547261:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574205.549748:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:0.0:1787574205.549769:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:5668:x1874407272222080:12345-192.168.206.51@tcp:13: 00002000:00000024:0.0:1787574205.549818:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574205.549901:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:5668:x1874407272222080:12345-192.168.206.51@tcp:13: Request processed in 139us (3763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574205.549907:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00010000:00010000:3.0:1787574206.194683:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574207.217549:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574207.610993:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290068608:0@lo:400: 00000100:00100000:3.0:1787574207.611088:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574207.611144:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874407290069120:0@lo:400: 00000100:00100000:3.0:1787574207.611198:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574207.611229:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574207.611252:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290068992:0@lo:400: 00000100:00100000:3.0:1787574207.611303:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574207.611347:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874407290068864:0@lo:400: 00000100:00100000:3.0:1787574207.611373:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574207.611392:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787574207.611397:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290068736:0@lo:400: 00000100:00100000:3.0:1787574207.611417:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574207.611434:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290069248:0@lo:400: 00000100:00100000:3.0:1787574207.611456:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574207.611489:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290068608 00000100:00100000:3.0:1787574207.611499:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290068608 00000100:00100000:3.0:1787574207.611551:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787574207.611561:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a03487050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:3301:x1874407290068608:12345-0@lo:400: 00000100:00100000:3.0:1787574207.611621:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a03487050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:3301:x1874407290068608:12345-0@lo:400: Request processed in 61us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574207.611629:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787574207.611664:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290069120 00000100:00100000:3.0:1787574207.611669:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290069120 00000100:00100000:3.0:1787574207.611703:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290068864 00000100:00100000:3.0:1787574207.611706:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290068864 00000100:00100000:3.0:1787574207.611720:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290068736 00000100:00100000:3.0:1787574207.611723:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290068736 00000100:00100000:3.0:1787574207.611736:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787574207.611743:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874407290069120:12345-0@lo:400: 00000100:00100000:3.0:1787574207.611787:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874407290069120:12345-0@lo:400: Request processed in 44us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574207.611793:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787574207.611806:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787574207.611821:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874407290068864:12345-0@lo:400: 00000100:00100000:3.0:1787574207.611855:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874407290068864:12345-0@lo:400: Request processed in 36us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574207.611861:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787574207.611872:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787574207.611878:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290068736:12345-0@lo:400: 00000100:00100000:3.0:1787574207.611903:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290068736:12345-0@lo:400: Request processed in 26us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574207.611909:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787574207.611933:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290068992 00000100:00100000:3.0:1787574207.611936:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290068992 00000100:00100000:3.0:1787574207.611960:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290069248 00000100:00100000:3.0:1787574207.611963:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290069248 00000100:00100000:3.0:1787574207.611975:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787574207.611981:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290068992:12345-0@lo:400: 00000100:00100000:3.0:1787574207.612012:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290068992:12345-0@lo:400: Request processed in 31us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574207.612018:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787574207.612029:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787574207.612035:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290069248:12345-0@lo:400: 00000100:00100000:3.0:1787574207.612061:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290069248:12345-0@lo:400: Request processed in 27us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574207.612066:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787574207.612115:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290068736:0@lo:400: 00010000:00080000:3.0:1787574207.612130:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a40fe0700 x1874407290069248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574207.612156:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290069248:0@lo:400: 00000100:00100000:3.0:1787574207.612192:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874407290068864:0@lo:400: 00010000:00080000:3.0:1787574207.612229:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a40fe0000 x1874407290068992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574207.612238:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290068992:0@lo:400: 00000100:00100000:3.0:1787574207.612247:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290068608:0@lo:400: 00000100:00100000:3.0:1787574207.612257:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874407290069120:0@lo:400: 00000100:00080000:2.0:1787574207.615973:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787574207.615983:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574207.615986:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1787574207.681119:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f 00000001:00100000:1.0:1787574207.682140:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f 00000100:00100000:3.0:1787574208.114703:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290069376:0@lo:13: 00000100:00100000:3.0:1787574208.114794:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574208.115010:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290069376 00000100:00100000:0.0:1787574208.115021:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290069376 00000100:00100000:0.0:1787574208.115082:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787574208.115094:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290069376:12345-0@lo:13: 00002000:00000024:0.0:1787574208.115153:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574208.115245:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290069376:12345-0@lo:13: Request processed in 153us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574208.115264:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787574208.115418:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419d9c00 x1874407290069376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574208.115441:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290069376:0@lo:13: 00010000:00010000:3.0:1787574208.243218:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574208.286573:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574208.286672:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574208.286705:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574208.286747:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574208.286789:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272222336 00000100:00100000:1.0:1787574208.286800:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272222336 00000100:00100000:1.0:1787574208.286880:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:1.0:1787574208.286892:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2353:x1874407272222336:12345-192.168.206.51@tcp:400: 00000100:00100000:1.0:1787574208.286971:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2353:x1874407272222336:12345-192.168.206.51@tcp:400: Request processed in 81us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574208.286979:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:1.0:1787574208.287003:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272222464 00000100:00100000:1.0:1787574208.287007:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272222464 00000100:00100000:1.0:1787574208.287030:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272222592 00000100:00100000:1.0:1787574208.287033:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272222592 00000100:00100000:1.0:1787574208.287051:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:1.0:1787574208.287057:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2353:x1874407272222464:12345-192.168.206.51@tcp:400: 00000100:00100000:1.0:1787574208.287085:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2353:x1874407272222464:12345-192.168.206.51@tcp:400: Request processed in 28us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574208.287092:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:1.0:1787574208.287103:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:1.0:1787574208.287108:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2353:x1874407272222592:12345-192.168.206.51@tcp:400: 00000100:00100000:1.0:1787574208.287132:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2353:x1874407272222592:12345-192.168.206.51@tcp:400: Request processed in 24us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574208.287137:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00080000:1.0:1787574208.287152:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787574208.287156:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787574208.287158:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574208.291005:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272222208 00000100:00100000:0.0:1787574208.291021:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272222208 00000100:00100000:0.0:1787574208.291091:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00100000:0.0:1787574208.291103:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a03484050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+10:2353:x1874407272222208:12345-192.168.206.51@tcp:400: 00000100:00100000:0.0:1787574208.291217:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a03484050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+10:2353:x1874407272222208:12345-192.168.206.51@tcp:400: Request processed in 117us (4657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574208.291226:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 129 00000001:02000400:2.0:1787574208.337995:0:8301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787574209.137934:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290069504:0@lo:13: 00000100:00100000:3.0:1787574209.138018:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574209.138131:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290069504 00000100:00100000:0.0:1787574209.138142:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290069504 00000100:00100000:0.0:1787574209.138251:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787574209.138263:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290069504:12345-0@lo:13: 00002000:00000024:0.0:1787574209.138303:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787574209.138381:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574209.139129:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290069504:12345-0@lo:13: Request processed in 865us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574209.139139:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787574209.139350:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419d9c00 x1874407290069504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574209.139375:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290069504:0@lo:13: 00010000:00010000:1.0:1787574209.270914:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574210.291568:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574211.316098:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787574212.085946:0:8448:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff91e83590 20000000:00000080:0.0:1787574212.085963:0:8448:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff982a41c54000 uarg=0000000000000000 20000000:01000000:0.0:1787574212.085997:0:8448:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1787574212.086000:0:8448:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1787574212.086003:0:8448:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787574212.086009:0:8448:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787574212.086020:0:8448:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1787574212.086034:0:8448:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787574212.086036:0:8448:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787574212.086435:0:8448:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787574212.086438:0:8448:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787574212.089215:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1787574212.089730:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1787574212.089814:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1787574212.089855:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1787574212.089884:0:8448:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787574212.089887:0:8448:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787574212.091916:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1787574212.092911:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1787574212.092966:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1787574212.093021:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1787574212.093038:0:8448:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787574212.093041:0:8448:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787574212.096902:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1787574212.097497:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1787574212.097552:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1787574212.097592:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1787574212.097610:0:8448:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787574212.097612:0:8448:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787574212.098526:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1787574212.098900:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1787574212.098966:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1787574212.099005:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1787574212.099025:0:8448:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787574212.099044:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf775 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574212.099061:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a42045000/0xfe91058e646bf672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf66b expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574212.099070:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a027f3a00/0xfe91058e646bf69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf695 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574212.099077:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a1d2ab000/0xfe91058e646bf6c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf6bf expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574212.099083:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a00031e00/0xfe91058e646bf6d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf6cd expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574212.099090:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a00030a00/0xfe91058e646bf6e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf6db expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574212.099096:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a1d2abe00/0xfe91058e646bf6fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf6f7 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574212.099129:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a42045800/0xfe91058e646bf728 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf71a expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574212.099139:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a00031400/0xfe91058e646bf736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1e9ef expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574212.099147:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a027f2c00/0xfe91058e646bf73d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1e9f6 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574212.099155:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf775 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574212.099234:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a027f2c00/0xfe91058e646bf73d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1e9f6 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574212.099253:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982a027f2c00/0xfe91058e646bf73d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1e9f6 expref: 9 pid: 5825 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574212.099270:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419db100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874407290069632:192.168.206.51@tcp:104: 00010000:00010000:2.0:1787574212.099372:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a00031400/0xfe91058e646bf736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1e9ef expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574212.099381:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982a00031400/0xfe91058e646bf736 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1e9ef expref: 9 pid: 5823 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574212.099390:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874407290069760:192.168.206.51@tcp:104: 00010000:00010000:2.0:1787574212.099421:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a42045800/0xfe91058e646bf728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf71a expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574212.099439:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a42045800/0xfe91058e646bf728 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf71a expref: 18 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574212.099449:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874407290069888:0@lo:104: 00000100:00100000:2.0:1787574212.099490:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574212.099535:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a1d2abe00/0xfe91058e646bf6fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf6f7 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574212.099544:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a1d2abe00/0xfe91058e646bf6fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf6f7 expref: 18 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574212.099552:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419db800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874407290070016:0@lo:104: 00000100:00100000:2.0:1787574212.099577:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574212.099599:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a00030a00/0xfe91058e646bf6e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf6db expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574212.099607:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a00030a00/0xfe91058e646bf6e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf6db expref: 18 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574212.099614:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874407290070144:0@lo:104: 00010000:00010000:2.0:1787574212.099636:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a00031e00/0xfe91058e646bf6d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf6cd expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574212.099644:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a00031e00/0xfe91058e646bf6d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf6cd expref: 18 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574212.099652:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419dbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874407290070272:0@lo:104: 00010000:00010000:2.0:1787574212.099672:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a1d2ab000/0xfe91058e646bf6c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf6bf expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574212.099686:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a1d2ab000/0xfe91058e646bf6c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf6bf expref: 18 pid: 5825 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574212.099694:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874407290070400:0@lo:104: 00010000:00010000:2.0:1787574212.099720:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a027f3a00/0xfe91058e646bf69c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf695 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574212.099727:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a027f3a00/0xfe91058e646bf69c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf695 expref: 18 pid: 5825 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574212.099735:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419daa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874407290070528:0@lo:104: 00010000:00010000:2.0:1787574212.099770:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a42045000/0xfe91058e646bf672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf66b expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574212.099780:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a42045000/0xfe91058e646bf672 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf66b expref: 18 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574212.099788:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874407290070656:0@lo:104: 00000100:00100000:2.0:1787574212.099809:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b6540 going to sleep for 11 seconds 00000100:00100000:3.0:1787574212.099908:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290069888 00000100:00100000:3.0:1787574212.099916:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290069888 00000100:00100000:1.0:1787574212.099919:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787574212.099941:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574212.099958:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574212.099965:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290070016 00000100:00100000:3.0:1787574212.099970:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290070016 00000100:00100000:1.0:1787574212.099974:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574212.099987:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290070144 00000100:00100000:3.0:1787574212.099991:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290070144 00000100:00100000:3.0:1787574212.100003:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290070272 00000100:00100000:1.0:1787574212.100004:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574212.100008:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290070272 00000100:00100000:3.0:1787574212.100023:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290070400 00000100:00100000:3.0:1787574212.100027:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290070400 00000100:00100000:1.0:1787574212.100028:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574212.100040:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290070528 00000100:00100000:3.0:1787574212.100044:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290070656 00000100:00100000:1.0:1787574212.100044:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290070528 00000100:00100000:3.0:1787574212.100049:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290070656 00000100:00100000:1.0:1787574212.100076:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787574212.100086:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+9:8448:x1874407290069888:12345-0@lo:104: 00010000:00010000:1.0:1787574212.100100:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf71a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf728 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574212.100189:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787574212.100196:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+9:8448:x1874407290069888:12345-0@lo:104: Request processed in 112us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574212.100203:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787574212.100220:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787574212.100226:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a98d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+8:8448:x1874407290070016:12345-0@lo:104: 00010000:00010000:1.0:1787574212.100234:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa600/0xfe91058e646bf6f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf6fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.100256:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574212.100265:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf71a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf728 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.100274:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00031c00 already unused, calling callback (ffffffffc1a17c20) 00010000:00010000:1.0:1787574212.100274:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:3.0:1787574212.100280:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf71a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf728 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574212.100283:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a98d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+8:8448:x1874407290070016:12345-0@lo:104: Request processed in 56us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574212.100297:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1787574212.100298:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf71a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf728 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574212.100307:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf71a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf728 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574212.100313:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787574212.100332:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787574212.100340:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+7:8448:x1874407290070144:12345-0@lo:104: 00010000:00010000:1.0:1787574212.100349:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf6db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf6e2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.100350:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf71a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf728 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.100365:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574212.100385:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf71a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf728 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.100395:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf71a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf728 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574212.100396:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787574212.100402:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+7:8448:x1874407290070144:12345-0@lo:104: Request processed in 64us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574212.100416:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1787574212.100427:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787574212.100432:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa600/0xfe91058e646bf6f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf6fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574212.100432:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1787574212.100442:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2aa600 already unused, calling callback (ffffffffc1a17c20) 00000100:00100000:1.0:1787574212.100443:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+6:8448:x1874407290070272:12345-0@lo:104: 10000000:00010000:3.0:1787574212.100449:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa600/0xfe91058e646bf6f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf6fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574212.100455:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a1d2aaa00/0xfe91058e646bf6cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf6d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.100460:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa600/0xfe91058e646bf6f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf6fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574212.100470:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa600/0xfe91058e646bf6f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf6fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574212.100476:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574212.100486:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787574212.100493:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+6:8448:x1874407290070272:12345-0@lo:104: Request processed in 52us (534us total) trans 0 rc 0/0 00010000:00010000:3.0:1787574212.100495:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa600/0xfe91058e646bf6f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf6fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574212.100502:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1787574212.100509:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787574212.100518:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787574212.100526:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+5:8448:x1874407290070400:12345-0@lo:104: 00010000:00010000:3.0:1787574212.100528:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa600/0xfe91058e646bf6f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf6fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574212.100534:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf6bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf6c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.100537:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa600/0xfe91058e646bf6f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf6fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.100557:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787574212.100561:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf6db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf6e2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574212.100571:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787574212.100580:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+5:8448:x1874407290070400:12345-0@lo:104: Request processed in 55us (607us total) trans 0 rc 0/0 00010000:00010000:3.0:1787574212.100584:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00031600 already unused, calling callback (ffffffffc1a17c20) 00000100:00100000:1.0:1787574212.100588:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 10000000:00010000:3.0:1787574212.100590:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf6db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf6e2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.100600:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf6db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf6e2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574212.100603:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 10000000:00010000:3.0:1787574212.100613:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf6db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf6e2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574212.100614:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+4:8448:x1874407290070528:12345-0@lo:104: 10000000:01000000:3.0:1787574212.100627:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574212.100628:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf69c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.100643:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf6db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf6e2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.100651:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574212.100733:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf6db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf6e2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.100740:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf6db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf6e2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574212.100745:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:3.0:1787574212.100762:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1787574212.100762:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+4:8448:x1874407290070528:12345-0@lo:104: Request processed in 149us (760us total) trans 0 rc 0/0 00010000:00010000:3.0:1787574212.100769:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a1d2aaa00/0xfe91058e646bf6cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf6d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574212.100773:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1787574212.100782:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2aaa00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1787574212.100786:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2aaa00/0xfe91058e646bf6cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf6d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574212.100793:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787574212.100804:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+3:8448:x1874407290070656:12345-0@lo:104: 00010000:00010000:3.0:1787574212.100809:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a1d2aaa00/0xfe91058e646bf6cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf6d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574212.100814:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf66b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf672 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574212.100818:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2aaa00/0xfe91058e646bf6cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf6d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574212.100828:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787574212.100848:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a1d2aaa00/0xfe91058e646bf6cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf6d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574212.100848:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787574212.100857:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+3:8448:x1874407290070656:12345-0@lo:104: Request processed in 56us (830us total) trans 0 rc 0/0 00010000:00010000:3.0:1787574212.100860:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787574212.100868:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1787574212.100870:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a1d2aaa00/0xfe91058e646bf6cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf6d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.100878:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a1d2aaa00/0xfe91058e646bf6cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf6d4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.100890:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787574212.100893:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf6bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf6c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.100898:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030e00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1787574212.100901:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf6bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf6c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.100907:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf6bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf6c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574212.100913:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf6bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf6c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574212.100924:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787574212.100939:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf6bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf6c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.100945:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574212.100949:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf6bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf6c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.100955:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf6bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf6c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.100964:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787574212.100967:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf69c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.100973:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030c00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1787574212.100975:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf69c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.100982:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf69c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574212.100988:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf69c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574212.100993:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787574212.101004:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf695 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf69c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.101009:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574212.101020:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf695 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf69c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.101026:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf695 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf69c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.101035:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574212.101038:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf66b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf672 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.101044:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a027f2e00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1787574212.101047:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf66b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf672 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.101053:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf66b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf672 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574212.101060:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf66b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf672 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574212.101064:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787574212.101077:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf66b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf672 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.101082:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574212.101086:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf66b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf672 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.101092:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf66b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf672 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.101105:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574212.101112:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574212.101114:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574212.101137:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290070784:0@lo:103: 00000100:00100000:3.0:1787574212.101192:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574212.101218:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290071296:0@lo:103: 00000100:00100000:3.0:1787574212.101239:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574212.101259:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574212.101265:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290071168:0@lo:103: 00000100:00100000:3.0:1787574212.101285:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574212.101314:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290070912:0@lo:103: 00000100:00100000:3.0:1787574212.101336:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574212.101347:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290071424:0@lo:103: 00000100:00100000:3.0:1787574212.101365:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574212.101377:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787574212.101382:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290071040:0@lo:103: 00000100:00100000:3.0:1787574212.101402:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574212.101412:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290071552:0@lo:103: 00000100:00100000:3.0:1787574212.101434:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574212.101459:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290070784 00000100:00100000:3.0:1787574212.101464:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290070784 00010000:00010000:3.0:1787574212.101487:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a42045800/0xfe91058e646bf728 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf71a expref: 19 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574212.101504:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290071296 00000100:00100000:3.0:1787574212.101506:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290071296 00010000:00010000:3.0:1787574212.101517:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a1d2ab000/0xfe91058e646bf6c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf6bf expref: 20 pid: 5825 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574212.101541:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290071168 00000100:00100000:3.0:1787574212.101544:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290071168 00010000:00010000:3.0:1787574212.101556:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a00031e00/0xfe91058e646bf6d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf6cd expref: 21 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574212.101565:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290070912 00000100:00100000:3.0:1787574212.101568:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290070912 00010000:00010000:3.0:1787574212.101576:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a1d2abe00/0xfe91058e646bf6fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf6f7 expref: 22 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574212.101585:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290071424 00000100:00100000:3.0:1787574212.101587:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290071424 00010000:00010000:3.0:1787574212.101597:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a027f3a00/0xfe91058e646bf69c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf695 expref: 23 pid: 5825 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574212.101606:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290071040 00000100:00100000:3.0:1787574212.101609:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290071040 00010000:00010000:3.0:1787574212.101619:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a00030a00/0xfe91058e646bf6e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf6db expref: 24 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574212.101629:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290071552 00000100:00100000:3.0:1787574212.101631:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290071552 00010000:00010000:3.0:1787574212.101640:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a42045000/0xfe91058e646bf672 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf66b expref: 25 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574212.101652:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787574212.101660:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+25:3301:x1874407290070784:12345-0@lo:103: 00010000:00010000:3.0:1787574212.101671:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574212.101676:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a42045800/0xfe91058e646bf728 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf71a expref: 25 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.101695:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a42045800/0xfe91058e646bf728 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf71a expref: 25 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.101712:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574212.101743:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+25:3301:x1874407290070784:12345-0@lo:103: Request processed in 84us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574212.101763:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787574212.101779:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787574212.101786:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+24:3301:x1874407290071296:12345-0@lo:103: 00010000:00010000:3.0:1787574212.101793:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574212.101799:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a1d2ab000/0xfe91058e646bf6c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf6bf expref: 24 pid: 5825 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.101807:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a1d2ab000/0xfe91058e646bf6c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf6bf expref: 24 pid: 5825 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.101818:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574212.101843:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+24:3301:x1874407290071296:12345-0@lo:103: Request processed in 57us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574212.101846:0:5815:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787574212.101852:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787574212.101858:0:5815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787574212.101870:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787574212.101878:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+23:3301:x1874407290071168:12345-0@lo:103: 00010000:00010000:3.0:1787574212.101886:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574212.101891:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a00031e00/0xfe91058e646bf6d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf6cd expref: 23 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.101900:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a00031e00/0xfe91058e646bf6d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf6cd expref: 23 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.101917:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574212.101940:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+23:3301:x1874407290071168:12345-0@lo:103: Request processed in 64us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574212.101947:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787574212.101965:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787574212.101972:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+22:3298:x1874407290070912:12345-0@lo:103: 00010000:00010000:3.0:1787574212.101981:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574212.101986:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a1d2abe00/0xfe91058e646bf6fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf6f7 expref: 22 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.101996:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a1d2abe00/0xfe91058e646bf6fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf6f7 expref: 22 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.102006:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574212.102034:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787574212.102039:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+22:3298:x1874407290070912:12345-0@lo:103: Request processed in 66us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574212.102048:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+22:3298:x1874407290071424:12345-0@lo:103: 00000100:00100000:3.0:1787574212.102050:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1787574212.102063:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787574212.102067:0:5817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1787574212.102069:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a027f3a00/0xfe91058e646bf69c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf695 expref: 21 pid: 5825 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574212.102078:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1787574212.102084:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a027f3a00/0xfe91058e646bf69c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf695 expref: 21 pid: 5825 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574212.102090:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+21:3298:x1874407290071040:12345-0@lo:103: 00010000:00010000:1.0:1787574212.102102:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574212.102104:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574212.102111:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a00030a00/0xfe91058e646bf6e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf6db expref: 21 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.102120:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a00030a00/0xfe91058e646bf6e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf6db expref: 21 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.102131:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574212.102160:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+21:3298:x1874407290071040:12345-0@lo:103: Request processed in 74us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574212.102291:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+21:3298:x1874407290071424:12345-0@lo:103: Request processed in 247us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574212.102298:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787574212.102310:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787574212.102319:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787574212.102328:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290071552:12345-0@lo:103: 00010000:00010000:3.0:1787574212.102338:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574212.102343:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a42045000/0xfe91058e646bf672 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf66b expref: 19 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.102352:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a42045000/0xfe91058e646bf672 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf66b expref: 19 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574212.102362:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574212.102389:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290071552:12345-0@lo:103: Request processed in 64us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574212.102397:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787574212.102485:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290071040:0@lo:103: 00000100:00100000:3.0:1787574212.102495:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290071552:0@lo:103: 00000100:00100000:3.0:1787574212.102503:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290070912:0@lo:103: 00000100:00100000:3.0:1787574212.102509:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290071424:0@lo:103: 00000100:00100000:3.0:1787574212.102548:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290071168:0@lo:103: 00000100:00100000:3.0:1787574212.102555:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290070784:0@lo:103: 00000100:00100000:3.0:1787574212.102561:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290071296:0@lo:103: 00010000:00010000:0.0:1787574212.102827:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574212.105158:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a42045800/0xfe91058e646bf728 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf71a expref: 18 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574212.105201:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874407290069888:0@lo:104: 00010000:00010000:2.0:1787574212.105216:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a1d2abe00/0xfe91058e646bf6fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf6f7 expref: 17 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574212.105225:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419db800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874407290070016:0@lo:104: 00010000:00010000:2.0:1787574212.105237:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a00030a00/0xfe91058e646bf6e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf6db expref: 16 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574212.105266:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874407290070144:0@lo:104: 00010000:00010000:2.0:1787574212.105281:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a00031e00/0xfe91058e646bf6d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf6cd expref: 15 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574212.105291:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419dbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874407290070272:0@lo:104: 00010000:00010000:2.0:1787574212.105301:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a1d2ab000/0xfe91058e646bf6c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf6bf expref: 14 pid: 5825 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574212.105309:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874407290070400:0@lo:104: 00010000:00010000:2.0:1787574212.105320:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a027f3a00/0xfe91058e646bf69c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf695 expref: 13 pid: 5825 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574212.105330:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419daa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874407290070528:0@lo:104: 00010000:00010000:0.0:1787574212.105429:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a42045000/0xfe91058e646bf672 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf66b expref: 12 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574212.105439:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874407290070656:0@lo:104: 00000100:00100000:2.0:1787574212.106506:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574212.106537:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574212.106607:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419db100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874407290069632:192.168.206.51@tcp:104: 00000100:00100000:0.0:1787574212.106618:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874407290069760:192.168.206.51@tcp:104: 00010000:00010000:0.0:1787574212.106661:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf775 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574212.106812:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272222720 00000100:00100000:1.0:1787574212.106820:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272222720 00010000:00010000:1.0:1787574212.106860:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a027f2c00/0xfe91058e646bf73d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1e9f6 expref: 10 pid: 5825 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574212.106899:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272222848 00000100:00100000:1.0:1787574212.106902:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272222848 00010000:00010000:1.0:1787574212.106915:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a00031400/0xfe91058e646bf736 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1e9ef expref: 11 pid: 5823 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574212.106954:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:0.0:1787574212.106964:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:1.0:1787574212.106970:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9891405-66e8-4ae2-851e-6434ae47d085+11:2350:x1874407272222720:12345-192.168.206.51@tcp:103: 00000100:00100000:0.0:1787574212.106981:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9891405-66e8-4ae2-851e-6434ae47d085+11:2351:x1874407272222848:12345-192.168.206.51@tcp:103: 00010000:00010000:1.0:1787574212.106991:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574212.106993:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574212.107001:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a027f2c00/0xfe91058e646bf73d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1e9f6 expref: 11 pid: 5825 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574212.107002:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a00031400/0xfe91058e646bf736 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1e9ef expref: 11 pid: 5823 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574212.107026:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a027f2c00/0xfe91058e646bf73d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1e9f6 expref: 11 pid: 5825 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574212.109306:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a00031400/0xfe91058e646bf736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1e9ef expref: 11 pid: 5823 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574212.109340:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a00031400/0xfe91058e646bf736 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1e9ef expref: 11 pid: 5823 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574212.109360:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574212.109452:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9891405-66e8-4ae2-851e-6434ae47d085+10:2351:x1874407272222848:12345-192.168.206.51@tcp:103: Request processed in 2475us (2912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574212.109477:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00010000:00010000:1.0:1787574212.113946:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a027f2c00/0xfe91058e646bf73d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1e9f6 expref: 9 pid: 5825 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574212.113986:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf775 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574212.113995:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf775 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574212.114018:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf775 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574212.114041:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf775 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574212.114048:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf775 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574212.114056:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf775 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574212.114062:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2ab400 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574212.114066:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf775 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574212.114074:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf775 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574212.114098:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf775 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574212.114231:0:8448:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf775 lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574212.114242:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf775 lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574212.118782:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a1d2ab400/0xfe91058e646bf775 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574212.118817:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574212.118905:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9891405-66e8-4ae2-851e-6434ae47d085+8:2350:x1874407272222720:12345-192.168.206.51@tcp:103: Request processed in 11936us (12411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574212.118916:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00010000:00010000:3.0:1787574212.337494:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574212.721694:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1874407290071808:0@lo:400: 00000100:00100000:1.0:1787574212.721718:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874407290071680:0@lo:400: 00000100:00100000:3.0:1787574212.721794:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290071936:0@lo:400: 00000100:00100000:2.0:1787574212.721868:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574212.721943:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290071808 00000100:00100000:2.0:1787574212.721951:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290071808 00000100:00100000:1.0:1787574212.721964:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574212.721990:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290072192:0@lo:400: 00000100:00100000:2.0:1787574212.722008:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290071680 00000100:00100000:2.0:1787574212.722013:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290071680 00000100:00100000:1.0:1787574212.722029:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574212.722059:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787574212.722069:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874407290071808:12345-0@lo:400: 00000100:00100000:1.0:1787574212.722079:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787574212.722091:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874407290071680:12345-0@lo:400: 00000100:00100000:2.0:1787574212.722132:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874407290071808:12345-0@lo:400: Request processed in 64us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574212.722145:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787574212.722146:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874407290071680:12345-0@lo:400: Request processed in 54us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574212.722155:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787574212.722204:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290072192 00000100:00100000:1.0:1787574212.722208:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290072192 00000100:00100000:1.0:1787574212.722238:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787574212.722245:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290072192:12345-0@lo:400: 00000100:00100000:1.0:1787574212.722276:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290072192:12345-0@lo:400: Request processed in 31us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574212.722282:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787574212.722709:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787574212.722714:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574212.724082:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874407290071680:0@lo:400: 00010000:00080000:1.0:1787574212.724107:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a05293100 x1874407290072192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574212.724119:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290072192:0@lo:400: 00000100:00100000:2.0:1787574212.724140:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1874407290071808:0@lo:400: 00000100:00100000:2.0:1787574212.724403:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874407290072064:0@lo:400: 00000100:00100000:2.0:1787574212.724470:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574212.724516:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290072064 00000100:00100000:2.0:1787574212.724521:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290072064 00000100:00100000:2.0:1787574212.724574:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787574212.724599:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874407290072064:12345-0@lo:400: 00000100:00100000:2.0:1787574212.724649:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874407290072064:12345-0@lo:400: Request processed in 67us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574212.724656:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787574212.724686:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874407290072064:0@lo:400: 00000100:00080000:2.0:1787574212.724700:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574212.728097:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574212.728377:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290071936 00000100:00100000:3.0:1787574212.728388:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290071936 00000100:00100000:3.0:1787574212.728456:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787574212.728469:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290071936:12345-0@lo:400: 00000100:00080000:2.0:1787574212.728710:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574212.728921:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290071936:12345-0@lo:400: Request processed in 455us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574212.728929:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787574212.729160:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a0355e300 x1874407290071936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574212.729990:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290071936:0@lo:400: 10000000:01000000:0.0:1787574213.233567:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787574213.233576:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982a3a5c3000 from 39 10000000:01000000:0.0:1787574213.233582:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787574213.233640:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf77c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574213.233653:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf77c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574213.233664:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf77c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574213.233690:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a2ff02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290072320:0@lo:101: 00000100:00100000:0.0:1787574213.233788:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574213.233859:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982906a61900 going to sleep for 11 seconds 00000100:00100000:3.0:1787574213.235066:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290072448:0@lo:13: 00000100:00100000:3.0:1787574213.235122:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574213.235330:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290072448 00000100:00100000:2.0:1787574213.235338:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290072448 00000100:00100000:1.0:1787574213.235381:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290072320 00000100:00100000:1.0:1787574213.235388:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290072320 00000100:00100000:2.0:1787574213.235412:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787574213.235430:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290072448:12345-0@lo:13: 00002000:00000024:2.0:1787574213.235472:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787574213.235523:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290072448:12345-0@lo:13: Request processed in 96us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574213.235548:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787574213.235588:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a05291500 x1874407290072448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574213.235607:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290072448:0@lo:13: 00000100:00100000:0.0:1787574213.237094:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787574213.237117:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a03485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+12:5827:x1874407290072320:12345-0@lo:101: 00010000:00010000:0.0:1787574213.237134:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574213.237157:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a00030800/0xfe91058e646bf783 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf77c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574213.237214:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a00030800/0xfe91058e646bf783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf77c expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574213.237243:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a00030800/0xfe91058e646bf783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf77c expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574213.237252:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a00030800, rc 0) 00000100:00100000:0.0:1787574213.237335:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a03485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+13:5827:x1874407290072320:12345-0@lo:101: Request processed in 230us (3548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574213.237341:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787574213.237436:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a2ff02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290072320:0@lo:101: 00010000:00010000:3.0:1787574213.237461:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf77c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574213.237472:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf77c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574213.237544:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290072576:0@lo:501: 00000100:00100000:3.0:1787574213.237580:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574213.237621:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3a6c3300 going to sleep for 11 seconds 00000100:00100000:2.0:1787574213.237940:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290072576 00000100:00100000:2.0:1787574213.237947:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290072576 00000100:00100000:2.0:1787574213.237990:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787574213.238000:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+13:5827:x1874407290072576:12345-0@lo:501: 00000100:00100000:2.0:1787574213.238758:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+13:5827:x1874407290072576:12345-0@lo:501: Request processed in 757us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574213.238767:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787574213.248423:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290072576:0@lo:501: 00000100:00100000:3.0:1787574213.248496:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290072704:0@lo:503: 00000100:00100000:3.0:1787574213.248585:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574213.248816:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3a6c3300 going to sleep for 11 seconds 00000100:00100000:2.0:1787574213.248990:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290072704 00000100:00100000:2.0:1787574213.248998:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290072704 00000100:00100000:2.0:1787574213.249109:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787574213.249120:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+13:5827:x1874407290072704:12345-0@lo:503: 00000100:00100000:2.0:1787574213.249350:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+13:5827:x1874407290072704:12345-0@lo:503: Request processed in 231us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574213.249358:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787574213.249436:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290072704:0@lo:503: 00000100:00100000:2.0:1787574213.250205:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05291500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8466:1874407290072832:0@lo:502: 00000100:00100000:2.0:1787574213.250262:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574213.250336:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787574213.250379:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290072832 00000100:00100000:1.0:1787574213.250386:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290072832 00000100:00100000:1.0:1787574213.250482:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787574213.250492:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+13:8466:x1874407290072832:12345-0@lo:502: 00000100:00100000:1.0:1787574213.250813:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+13:8466:x1874407290072832:12345-0@lo:502: Request processed in 322us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574213.250821:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787574213.250856:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05291500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8466:1874407290072832:0@lo:502: 00000100:00100000:2.0:1787574213.250899:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05291500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8466:1874407290072960:0@lo:502: 00000100:00100000:2.0:1787574213.250943:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574213.250975:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574213.251095:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290072960 00000100:00100000:3.0:1787574213.251106:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290072960 00000100:00100000:3.0:1787574213.251139:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787574213.251147:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+13:8466:x1874407290072960:12345-0@lo:502: 00000100:00100000:3.0:1787574213.251319:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+13:8466:x1874407290072960:12345-0@lo:502: Request processed in 171us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574213.251326:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787574213.251436:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05291500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8466:1874407290072960:0@lo:502: 00000040:00080000:2.0:1787574213.251456:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787574213.251757:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787574213.251777:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787574213.251788:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf77c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574213.251800:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf77c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574213.251810:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787574213.251813:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1787574213.251816:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787574213.251842:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf78a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574213.251851:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf78a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574213.251860:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf78a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574213.251874:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290073088:0@lo:101: 00000100:00100000:3.0:1787574213.251903:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574213.252053:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3a6c3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787574213.252089:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290073088 00000100:00100000:1.0:1787574213.252094:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290073088 00000100:00100000:1.0:1787574213.252158:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787574213.252309:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+13:5827:x1874407290073088:12345-0@lo:101: 00010000:00010000:1.0:1787574213.252319:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574213.252331:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a42044600/0xfe91058e646bf791 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf78a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574213.252352:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a42044600/0xfe91058e646bf791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf78a expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574213.252361:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a42044600/0xfe91058e646bf791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf78a expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574213.252369:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a42044600, rc 0) 00000100:00100000:1.0:1787574213.252447:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+14:5827:x1874407290073088:12345-0@lo:101: Request processed in 281us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574213.252453:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787574213.252509:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290073088:0@lo:101: 00010000:00010000:3.0:1787574213.252530:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf78a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf791 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574213.252538:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf78a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf791 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574213.252583:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290073216:0@lo:501: 00000100:00100000:3.0:1787574213.252609:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574213.252678:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3a6c3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574213.252780:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290073216 00000100:00100000:0.0:1787574213.252785:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290073216 00000100:00100000:0.0:1787574213.252853:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787574213.252861:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+14:5827:x1874407290073216:12345-0@lo:501: 00000100:00100000:0.0:1787574213.253127:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+14:5827:x1874407290073216:12345-0@lo:501: Request processed in 265us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574213.253134:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787574213.253205:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290073216:0@lo:501: 00000100:00100000:1.0:1787574213.253234:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290073344:0@lo:503: 00000100:00100000:1.0:1787574213.253271:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574213.253830:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a07d7ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574213.253869:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290073344 00000100:00100000:3.0:1787574213.253874:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290073344 00000100:00100000:0.0:1787574213.253928:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787574213.253937:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+14:5827:x1874407290073344:12345-0@lo:503: 00000100:00100000:0.0:1787574213.254114:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+14:5827:x1874407290073344:12345-0@lo:503: Request processed in 178us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574213.254121:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787574213.254198:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290073344:0@lo:503: 00000100:00100000:1.0:1787574213.254424:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8467:1874407290073472:0@lo:502: 00000100:00100000:1.0:1787574213.254461:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574213.255370:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a07d7bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787574213.255406:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290073472 00000100:00100000:2.0:1787574213.255413:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290073472 00000100:00100000:2.0:1787574213.255453:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787574213.255462:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+14:8467:x1874407290073472:12345-0@lo:502: 00000100:00100000:2.0:1787574213.255664:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+14:8467:x1874407290073472:12345-0@lo:502: Request processed in 201us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574213.255671:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787574213.255772:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8467:1874407290073472:0@lo:502: 00000020:01000000:1.0:1787574213.255809:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574213.255820:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574213.255823:0:8467:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787574213.255828:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787574213.255857:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8467:1874407290073600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574213.255893:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574213.255931:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a07d7bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787574213.256061:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290073600 00000100:00100000:2.0:1787574213.256066:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290073600 00000100:00100000:2.0:1787574213.256082:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787574213.256088:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+14:8467:x1874407290073600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574213.256249:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+14:8467:x1874407290073600:12345-0@lo:502:llog_process_th.0 Request processed in 159us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574213.256256:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787574213.256472:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8467:1874407290073600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787574213.256492:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574213.256497:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574213.256498:0:8467:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787574213.256502:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787574213.256849:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787574213.256869:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787574213.256879:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf78a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf791 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574213.256890:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf78a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf791 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574213.256900:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787574213.256903:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982a41658000 from 39 10000000:01000000:2.0:1787574213.256906:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787574213.257001:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf798 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574213.257009:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf798 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574213.257018:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf798 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574213.257035:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05291500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290073728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787574213.257072:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574213.257105:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574213.257152:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290073728 00000100:00100000:1.0:1787574213.257157:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290073728 00000100:00100000:1.0:1787574213.257222:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787574213.257230:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+14:5827:x1874407290073728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574213.257240:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574213.257253:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a42045200/0xfe91058e646bf79f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf798 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574213.257274:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a42045200/0xfe91058e646bf79f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf798 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574213.257284:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a42045200/0xfe91058e646bf79f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf798 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574213.257293:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a42045200, rc 0) 00000100:00100000:1.0:1787574213.257828:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+15:5827:x1874407290073728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 598us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574213.257851:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787574213.258005:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05291500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290073728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574213.258020:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf798 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf79f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574213.258030:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf798 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf79f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574213.258089:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05291500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290073856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574213.258121:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574213.258144:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574213.258212:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290073856 00000100:00100000:0.0:1787574213.258217:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290073856 00000100:00100000:0.0:1787574213.258293:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787574213.258302:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+15:5827:x1874407290073856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574213.258584:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+15:5827:x1874407290073856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574213.258600:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787574213.258689:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05291500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290073856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574213.258729:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05291500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290073984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574213.258777:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574213.261298:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574213.261484:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290073984 00000100:00100000:3.0:1787574213.261497:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290073984 00000100:00100000:3.0:1787574213.261552:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787574213.261564:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+15:5827:x1874407290073984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574213.262665:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+15:5827:x1874407290073984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1100us (3883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574213.262681:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787574213.263561:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05291500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290073984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574213.264047:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8468:1874407290074112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574213.264111:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574213.264234:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290074112 00000100:00100000:3.0:1787574213.264240:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290074112 00000100:00100000:3.0:1787574213.264274:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787574213.264281:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+15:8468:x1874407290074112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574213.264501:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+15:8468:x1874407290074112:12345-0@lo:502:llog_process_th.0 Request processed in 219us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574213.264515:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787574213.264560:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3a6c33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574213.264574:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8468:1874407290074112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574213.264611:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8468:1874407290074240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574213.264643:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574213.264662:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290074240 00000100:00100000:3.0:1787574213.264666:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290074240 00000100:00100000:3.0:1787574213.264682:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787574213.264688:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+15:8468:x1874407290074240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574213.266607:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3a6c33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574213.267407:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+15:8468:x1874407290074240:12345-0@lo:502:llog_process_th.0 Request processed in 2714us (2759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574213.267418:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787574213.267504:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8468:1874407290074240:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787574213.267538:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787574213.269331:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787574213.269364:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787574213.269376:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf798 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf79f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574213.269387:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf79f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574213.269398:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787574213.269401:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787574213.269403:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787574213.269442:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf7a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574213.269451:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf7a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574213.269462:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf7a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574213.269487:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05290700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290074368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787574213.269554:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574213.269632:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b6240 going to sleep for 11 seconds 00000100:00100000:0.0:1787574213.269671:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290074368 00000100:00100000:0.0:1787574213.269750:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290074368 00000100:00100000:0.0:1787574213.270646:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787574213.270660:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+15:5827:x1874407290074368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574213.270674:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574213.270771:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a00031e00/0xfe91058e646bf7ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf7a6 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574213.270796:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a00031e00/0xfe91058e646bf7ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf7a6 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574213.270807:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a00031e00/0xfe91058e646bf7ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf7a6 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574213.270815:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a00031e00, rc 0) 00000100:00100000:0.0:1787574213.270930:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+16:5827:x1874407290074368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 274us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574213.270936:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787574213.271125:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05290700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290074368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574213.271143:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf7a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf7ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574213.271242:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf7a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf7ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574213.271304:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05290700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290074496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574213.271336:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574213.271413:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b6240 going to sleep for 11 seconds 00000100:00100000:0.0:1787574213.271504:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290074496 00000100:00100000:0.0:1787574213.271510:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290074496 00000100:00100000:0.0:1787574213.271545:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787574213.271552:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+16:5827:x1874407290074496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574213.272528:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+16:5827:x1874407290074496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 974us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574213.272548:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787574213.272665:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05290700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290074496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574213.272792:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05290700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290074624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574213.272839:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574213.272903:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b6240 going to sleep for 11 seconds 00000100:00100000:1.0:1787574213.272989:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290074624 00000100:00100000:1.0:1787574213.272995:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290074624 00000100:00100000:1.0:1787574213.273065:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787574213.273075:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+16:5827:x1874407290074624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574213.273274:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+16:5827:x1874407290074624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574213.273282:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787574213.273366:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05290700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290074624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574213.274506:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05290700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8469:1874407290074752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574213.274563:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574213.274604:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b6600 going to sleep for 11 seconds 00000100:00100000:3.0:1787574213.274779:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290074752 00000100:00100000:3.0:1787574213.274785:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290074752 00000100:00100000:3.0:1787574213.274897:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787574213.275029:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04966c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+16:8469:x1874407290074752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574213.275769:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04966c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+16:8469:x1874407290074752:12345-0@lo:502:llog_process_th.0 Request processed in 740us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574213.275777:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787574213.275939:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05290700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8469:1874407290074752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787574213.275971:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574213.275983:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574213.275985:0:8469:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787574213.275991:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787574213.276019:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8469:1874407290074880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574213.276062:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574213.278146:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3a6c3180 going to sleep for 11 seconds 00000100:00100000:0.0:1787574213.278568:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290074880 00000100:00100000:0.0:1787574213.278578:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290074880 00000100:00100000:1.0:1787574213.278623:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787574213.278636:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04965450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+16:8469:x1874407290074880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574213.279125:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04965450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+16:8469:x1874407290074880:12345-0@lo:502:llog_process_th.0 Request processed in 491us (3061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574213.279145:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787574213.279367:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8469:1874407290074880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787574213.279400:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574213.279408:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574213.279418:0:8469:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787574213.279423:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1787574213.280774:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787574213.280802:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787574213.280813:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf7a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf7ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574213.280824:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf7a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf7ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574213.280834:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787574213.280837:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982a0622a800 from 39 10000000:01000000:0.0:1787574213.280840:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787574213.280876:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf7b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574213.280884:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf7b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574213.280894:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf7b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574213.280978:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a2ff00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290075008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787574213.281042:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574213.281115:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290075008 00000100:00100000:1.0:1787574213.281122:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290075008 00000100:00100000:0.0:1787574213.281128:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982906a61480 going to sleep for 11 seconds 00000100:00100000:1.0:1787574213.281226:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787574213.281236:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04967450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+16:5827:x1874407290075008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574213.281248:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574213.281260:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a42045000/0xfe91058e646bf7bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf7b4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574213.281287:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a42045000/0xfe91058e646bf7bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf7b4 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574213.281298:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a42045000/0xfe91058e646bf7bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf7b4 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574213.281324:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a42045000, rc 0) 00000100:00100000:1.0:1787574213.281409:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04967450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290075008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574213.281416:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787574213.281475:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a2ff00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290075008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574213.281489:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf7b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf7bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574213.281498:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf7b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf7bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574213.281546:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290075136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574213.281573:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574213.281602:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3a6c3180 going to sleep for 11 seconds 00000100:00100000:2.0:1787574213.281778:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290075136 00000100:00100000:2.0:1787574213.281783:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290075136 00000100:00100000:2.0:1787574213.281852:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787574213.281861:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290075136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574213.282263:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290075136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 403us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574213.282271:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787574213.282353:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290075136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574213.282386:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290075264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574213.282500:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574213.282570:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3a6c3180 going to sleep for 11 seconds 00000100:00100000:1.0:1787574213.282602:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290075264 00000100:00100000:1.0:1787574213.282607:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290075264 00000100:00100000:1.0:1787574213.282643:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787574213.282650:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290075264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574213.283160:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290075264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 508us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574213.283193:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787574213.283417:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290075264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574213.285493:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05292d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8470:1874407290075392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574213.285584:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574213.285663:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b6540 going to sleep for 11 seconds 00000100:00100000:0.0:1787574213.285834:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290075392 00000100:00100000:0.0:1787574213.285841:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290075392 00000100:00100000:0.0:1787574213.286110:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787574213.286121:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04965c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+17:8470:x1874407290075392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574213.286832:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04965c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+17:8470:x1874407290075392:12345-0@lo:502:llog_process_th.0 Request processed in 711us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574213.286840:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787574213.286934:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05292d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8470:1874407290075392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574213.287002:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8470:1874407290075520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574213.287045:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574213.287679:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3a6c3180 going to sleep for 11 seconds 00000100:00100000:2.0:1787574213.288075:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290075520 00000100:00100000:2.0:1787574213.288082:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290075520 00000100:00100000:2.0:1787574213.288121:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787574213.288308:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04964050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+17:8470:x1874407290075520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574213.288579:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04964050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+17:8470:x1874407290075520:12345-0@lo:502:llog_process_th.0 Request processed in 451us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574213.288587:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787574213.288835:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8470:1874407290075520:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787574213.288866:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787574213.289383:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787574213.289405:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787574213.289425:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf7b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf7bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574213.289436:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf7b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf7bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574213.289447:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787574213.289449:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1787574213.289452:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787574213.289486:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab000/0xfe91058e646bf7c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574213.289494:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab000/0xfe91058e646bf7c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574213.289503:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab000/0xfe91058e646bf7c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574213.289535:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05290000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290075648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787574213.289576:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574213.289614:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b6540 going to sleep for 11 seconds 00000100:00100000:3.0:1787574213.289819:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290075648 00000100:00100000:3.0:1787574213.289825:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290075648 00000100:00100000:3.0:1787574213.289861:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787574213.289869:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04964850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290075648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574213.289879:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574213.289891:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a027f2800/0xfe91058e646bf7c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf7c2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574213.289924:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a027f2800/0xfe91058e646bf7c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf7c2 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574213.289934:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a027f2800/0xfe91058e646bf7c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf7c2 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574213.289952:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a027f2800, rc 0) 00000100:00100000:3.0:1787574213.289997:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04964850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290075648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574213.290003:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787574213.290243:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05290000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290075648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574213.290257:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab000/0xfe91058e646bf7c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf7c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574213.290266:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab000/0xfe91058e646bf7c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf7c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574213.290318:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05290000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290075776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574213.290344:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574213.290366:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b6540 going to sleep for 11 seconds 00000100:00100000:3.0:1787574213.290504:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290075776 00000100:00100000:3.0:1787574213.290509:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290075776 00000100:00100000:3.0:1787574213.290530:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787574213.290537:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290075776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574213.291087:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05290000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290075776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574213.291118:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05290000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290075904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574213.291190:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574213.291202:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b6540 going to sleep for 11 seconds 00000100:00100000:3.0:1787574213.291315:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290075776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 398us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574213.291325:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787574213.291351:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290075904 00000100:00100000:3.0:1787574213.291356:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290075904 00000100:00100000:3.0:1787574213.291376:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787574213.291382:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290075904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574213.291538:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290075904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574213.291551:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787574213.291690:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05290000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290075904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574213.292356:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05290000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8471:1874407290076032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574213.292439:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574213.292471:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574213.292659:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290076032 00000100:00100000:0.0:1787574213.292665:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290076032 00000100:00100000:0.0:1787574213.292692:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787574213.292700:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04966450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:8471:x1874407290076032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574213.292929:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04966450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:8471:x1874407290076032:12345-0@lo:502:llog_process_th.0 Request processed in 229us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574213.293071:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05290000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8471:1874407290076032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787574213.293100:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574213.293111:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574213.293113:0:8471:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787574213.293119:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787574213.293156:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8471:1874407290076160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574213.293213:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574213.293229:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3a6c3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574213.293328:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787574213.293360:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290076160 00000100:00100000:0.0:1787574213.293365:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290076160 00000100:00100000:0.0:1787574213.293382:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787574213.293388:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04965050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:8471:x1874407290076160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574213.293542:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04965050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:8471:x1874407290076160:12345-0@lo:502:llog_process_th.0 Request processed in 153us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574213.293548:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787574213.293676:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8471:1874407290076160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787574213.293697:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574213.293701:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574213.293704:0:8471:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787574213.293707:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787574213.293867:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1787574213.293882:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787574213.293891:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab000/0xfe91058e646bf7c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf7c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574213.294089:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab000/0xfe91058e646bf7c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf7c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574213.294101:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787574213.294104:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff982a0488b370 from 1 10000000:01000000:0.0:1787574213.294115:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787574213.294302:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf7d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574213.294310:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf7d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574213.294320:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf7d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574213.294337:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a2ff00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290076288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787574213.294373:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574213.294447:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982906a61480 going to sleep for 11 seconds 00000100:00100000:1.0:1787574213.294803:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290076288 00000100:00100000:1.0:1787574213.294810:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290076288 00000100:00100000:3.0:1787574213.294865:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787574213.294875:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04964c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290076288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574213.294886:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574213.294909:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a027f3600/0xfe91058e646bf7d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf7d0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574213.294932:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a027f3600/0xfe91058e646bf7d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf7d0 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574213.295049:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a027f3600/0xfe91058e646bf7d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf7d0 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574213.295059:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a027f3600, rc 0) 00000100:00100000:3.0:1787574213.295117:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04964c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290076288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 241us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574213.295123:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787574213.295356:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a2ff00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290076288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574213.295370:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf7d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf7d7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574213.295379:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf7d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf7d7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574213.295504:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a2ff00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290076416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574213.295532:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574213.295561:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982906a61480 going to sleep for 11 seconds 00000100:00100000:3.0:1787574213.295602:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290076416 00000100:00100000:3.0:1787574213.295606:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290076416 00000100:00100000:3.0:1787574213.295639:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787574213.295647:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04967850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290076416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574213.296054:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04967850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290076416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 407us (520us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787574213.296062:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787574213.296379:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a2ff00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290076416:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787574213.296479:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787574213.296496:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf7d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf7d7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574213.296505:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf7d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf7d7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574213.364184:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574213.406122:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574213.406200:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574213.406222:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574213.406358:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272222976 00000100:00100000:0.0:1787574213.406368:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272222976 00000100:00100000:0.0:1787574213.406422:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 162 00000100:00100000:0.0:1787574213.406432:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+8:2353:x1874407272222976:12345-192.168.206.51@tcp:400: 00000100:00100000:0.0:1787574213.406527:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+8:2353:x1874407272222976:12345-192.168.206.51@tcp:400: Request processed in 96us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574213.406535:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 162 00000100:00100000:2.0:1787574213.407271:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574213.407412:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272223104 00000100:00100000:1.0:1787574213.407419:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272223104 00000100:00100000:1.0:1787574213.407477:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:1.0:1787574213.407486:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2352:x1874407272223104:12345-192.168.206.51@tcp:400: 00000100:00100000:1.0:1787574213.407537:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2352:x1874407272223104:12345-192.168.206.51@tcp:400: Request processed in 52us (1426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574213.407544:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00080000:0.0:1787574213.411029:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574213.414137:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272223360 00000100:00100000:3.0:1787574213.414152:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272223360 00000100:00080000:0.0:1787574213.414275:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787574213.414311:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272223232 00000100:00100000:3.0:1787574213.414316:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272223232 00000100:00100000:1.0:1787574213.414337:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:2.0:1787574213.414368:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00080000:0.0:1787574213.414375:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574213.414379:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787574213.414422:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787574213.414431:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:3.0:1787574213.414438:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2353:x1874407272223232:12345-192.168.206.51@tcp:400: 00000100:00100000:1.0:1787574213.414511:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2352:x1874407272223360:12345-192.168.206.51@tcp:400: 00000100:00100000:3.0:1787574213.414868:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2353:x1874407272223232:12345-192.168.206.51@tcp:400: Request processed in 428us (7598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574213.414876:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1787574213.418920:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2352:x1874407272223360:12345-192.168.206.51@tcp:400: Request processed in 4561us (12684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574213.418936:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:0.0:1787574214.259334:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290076544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574214.259425:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574214.259453:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290076544 00000100:00100000:2.0:1787574214.259462:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290076544 00000100:00080000:0.0:1787574214.259528:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574214.259544:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574214.259554:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290076544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574214.259590:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787574214.259706:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290076544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574214.259714:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787574214.260670:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a05293480 x1874407290076544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574214.260691:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290076544:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787574214.385549:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574214.810479:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574214.810567:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272223488 00000100:00100000:3.0:1787574214.810577:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272223488 00000100:00100000:3.0:1787574214.810636:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 163 00000100:00100000:3.0:1787574214.810647:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+8:5591:x1874407272223488:12345-192.168.206.51@tcp:101: 00010000:00010000:3.0:1787574214.810663:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574214.810690:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a027f3400/0xfe91058e646bf7de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ea58 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574214.810742:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a027f3400/0xfe91058e646bf7de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea58 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574214.810754:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a027f3400/0xfe91058e646bf7de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea58 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574214.810764:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a027f3400, rc 0) 00000100:00100000:3.0:1787574214.811551:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+9:5591:x1874407272223488:12345-192.168.206.51@tcp:101: Request processed in 197us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574214.811561:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 163 00000100:00100000:0.0:1787574214.815681:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574214.815825:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272223616 00000100:00100000:3.0:1787574214.815849:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272223616 00000100:00100000:3.0:1787574214.815900:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 164 00000100:00100000:3.0:1787574214.815910:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+9:5591:x1874407272223616:12345-192.168.206.51@tcp:501: 00000100:00100000:3.0:1787574214.816631:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+9:5591:x1874407272223616:12345-192.168.206.51@tcp:501: Request processed in 719us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574214.816640:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 164 00000100:00100000:1.0:1787574214.822748:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574214.823001:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272223744 00000100:00100000:3.0:1787574214.823011:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272223744 00000100:00100000:3.0:1787574214.823081:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 165 00000100:00100000:3.0:1787574214.823092:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+9:5591:x1874407272223744:12345-192.168.206.51@tcp:503: 00000100:00100000:3.0:1787574214.823356:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+9:5591:x1874407272223744:12345-192.168.206.51@tcp:503: Request processed in 265us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574214.823365:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 165 00000100:00100000:1.0:1787574214.827509:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574214.827655:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272223872 00000100:00100000:0.0:1787574214.827677:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272223872 00000100:00100000:0.0:1787574214.827732:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 166 00000100:00100000:0.0:1787574214.827754:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+9:6070:x1874407272223872:12345-192.168.206.51@tcp:502: 00000100:00100000:0.0:1787574214.828254:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+9:6070:x1874407272223872:12345-192.168.206.51@tcp:502: Request processed in 501us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574214.828263:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 166 00000100:00100000:2.0:1787574214.831333:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574214.831803:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272224000 00000100:00100000:0.0:1787574214.831813:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272224000 00000100:00100000:0.0:1787574214.832125:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 167 00000100:00100000:0.0:1787574214.832136:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+9:6070:x1874407272224000:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787574214.832462:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+9:6070:x1874407272224000:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 327us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574214.832477:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 167 00000100:00100000:1.0:1787574214.836822:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574214.837125:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272224128 00000100:00100000:3.0:1787574214.837150:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272224128 00000100:00100000:3.0:1787574214.837258:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 168 00000100:00100000:3.0:1787574214.837269:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+9:5591:x1874407272224128:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574214.837443:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574214.837466:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a027f3200/0xfe91058e646bf7e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ea5f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574214.837500:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a027f3200/0xfe91058e646bf7e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea5f expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574214.837511:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a027f3200/0xfe91058e646bf7e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea5f expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574214.837520:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a027f3200, rc 0) 00000100:00100000:3.0:1787574214.837586:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+10:5591:x1874407272224128:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 319us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574214.837594:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 168 00000100:00100000:1.0:1787574214.841805:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574214.841915:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272224256 00000100:00100000:0.0:1787574214.841924:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272224256 00000100:00100000:0.0:1787574214.841984:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 169 00000100:00100000:0.0:1787574214.841994:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+10:5591:x1874407272224256:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574214.842417:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+10:5591:x1874407272224256:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 424us (620us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787574214.842425:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 169 00010000:00010000:0.0:1787574215.409543:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787574216.229045:0:8510:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc65aac0d0 20000000:00000080:0.0:1787574216.229064:0:8510:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff982a41c54400 uarg=0000000000000000 20000000:01000000:0.0:1787574216.229193:0:8510:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787574216.229200:0:8510:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787574216.229206:0:8510:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787574216.231369:0:8511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787574216.231615:0:8510:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787574216.238286:0:8510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787574216.238352:0:8510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787574216.238772:0:8510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787574216.238794:0:8510:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787574216.238818:0:8510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7ec lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574216.238840:0:8510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a00031200/0xfe91058e646bf561 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf55a expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574216.238848:0:8510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a00030000/0xfe91058e646bf5c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf5bc expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574216.238855:0:8510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a42044a00/0xfe91058e646bf68e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf687 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574216.238866:0:8510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a1d2abc00/0xfe91058e646bf74b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea27 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574216.238880:0:8510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7ec lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574216.238938:0:8510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a1d2abc00/0xfe91058e646bf74b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea27 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574216.238969:0:8510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982a1d2abc00/0xfe91058e646bf74b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea27 expref: 9 pid: 5824 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574216.238986:0:8510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874407290076672:192.168.206.51@tcp:104: 00010000:00010000:1.0:1787574216.239119:0:8510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a42044a00/0xfe91058e646bf68e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf687 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574216.239128:0:8510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a42044a00/0xfe91058e646bf68e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf687 expref: 18 pid: 5824 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574216.239137:0:8510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874407290076800:0@lo:104: 00000100:00100000:1.0:1787574216.239860:0:8510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574216.239945:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290076800 00000100:00100000:3.0:1787574216.239954:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290076800 00000100:00100000:3.0:1787574216.240018:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787574216.240049:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7182851c-b624-4982-87cf-e891100b1765+3:8510:x1874407290076800:12345-0@lo:104: 00010000:00010000:3.0:1787574216.240065:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a027f2000/0xfe91058e646bf687 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf68e expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574216.240129:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787574216.240136:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7182851c-b624-4982-87cf-e891100b1765+3:8510:x1874407290076800:12345-0@lo:104: Request processed in 109us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574216.240145:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1787574216.240218:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574216.240225:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a027f2000/0xfe91058e646bf687 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf68e expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574216.240234:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a027f2000 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1787574216.240239:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a027f2000/0xfe91058e646bf687 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf68e expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574216.240249:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a027f2000/0xfe91058e646bf687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf68e expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574216.240250:0:8510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a00030000/0xfe91058e646bf5c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf5bc expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574216.240270:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a027f2000/0xfe91058e646bf687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf68e expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574216.240274:0:8510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a00030000/0xfe91058e646bf5c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf5bc expref: 18 pid: 5823 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574216.240283:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1787574216.240294:0:8510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874407290076928:0@lo:104: 00010000:00010000:3.0:1787574216.240320:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a027f2000/0xfe91058e646bf687 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf68e expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574216.240328:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787574216.240338:0:8510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787574216.240356:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a027f2000/0xfe91058e646bf687 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf68e expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574216.240365:0:8510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a00031200/0xfe91058e646bf561 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf55a expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574216.240367:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a027f2000/0xfe91058e646bf687 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf68e expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574216.240380:0:8510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a00031200/0xfe91058e646bf561 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf55a expref: 18 pid: 5823 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574216.240391:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574216.240391:0:8510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874407290077184:0@lo:104: 00000100:00100000:1.0:1787574216.240408:0:8510:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a07d7bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574216.240435:0:8510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874407290076800:0@lo:104: 00000100:00100000:0.0:1787574216.241063:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574216.241079:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290077056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574216.241120:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574216.241503:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290077056 00000100:00100000:1.0:1787574216.241509:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290077056 00010000:00010000:1.0:1787574216.241543:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a42044a00/0xfe91058e646bf68e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf687 expref: 19 pid: 5824 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574216.241579:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787574216.241587:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290077056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787574216.241600:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574216.241607:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a42044a00/0xfe91058e646bf68e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf687 expref: 19 pid: 5824 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574216.241619:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a42044a00/0xfe91058e646bf68e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf687 expref: 19 pid: 5824 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574216.241634:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a42044a00/0xfe91058e646bf68e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf687 expref: 19 pid: 5824 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574216.241994:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574216.241996:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574216.242023:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787574216.242047:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574216.242076:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290076928 00000100:00100000:3.0:1787574216.242089:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290076928 00000100:00100000:3.0:1787574216.242109:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290077184 00000100:00100000:3.0:1787574216.242112:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290077184 00000100:00100000:3.0:1787574216.242125:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787574216.242131:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982904729c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7182851c-b624-4982-87cf-e891100b1765+4:8510:x1874407290076928:12345-0@lo:104: 00010000:00010000:3.0:1787574216.242142:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa800/0xfe91058e646bf5bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf5c3 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574216.242220:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787574216.242226:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982904729c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7182851c-b624-4982-87cf-e891100b1765+4:8510:x1874407290076928:12345-0@lo:104: Request processed in 96us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574216.242233:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787574216.242278:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787574216.242285:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7182851c-b624-4982-87cf-e891100b1765+3:8510:x1874407290077184:12345-0@lo:104: 00010000:00010000:3.0:1787574216.242293:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf55a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf561 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574216.242325:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787574216.242330:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7182851c-b624-4982-87cf-e891100b1765+3:8510:x1874407290077184:12345-0@lo:104: Request processed in 46us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574216.242336:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787574216.242350:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787574216.242355:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa800/0xfe91058e646bf5bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf5c3 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574216.242363:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2aa800 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1787574216.242367:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa800/0xfe91058e646bf5bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf5c3 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574216.242387:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa800/0xfe91058e646bf5bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf5c3 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574216.242394:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa800/0xfe91058e646bf5bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf5c3 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574216.242413:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787574216.242445:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa800/0xfe91058e646bf5bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf5c3 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574216.242451:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574216.242468:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa800/0xfe91058e646bf5bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf5c3 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574216.242476:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa800/0xfe91058e646bf5bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf5c3 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574216.242489:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574216.242492:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf55a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf561 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574216.242498:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a42044200 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1787574216.242501:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf55a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf561 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574216.242508:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf55a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf561 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574216.242515:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf55a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf561 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574216.242527:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787574216.242543:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf55a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf561 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574216.242549:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574216.242555:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf55a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf561 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574216.242561:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf55a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf561 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574216.242576:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574216.242578:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574216.242579:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574216.242628:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574216.242680:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7182851c-b624-4982-87cf-e891100b1765+18:3298:x1874407290077056:12345-0@lo:103:ldlm_bl.0 Request processed in 1093us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574216.242688:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787574216.242747:0:8510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874407290076928:0@lo:104: 00000100:00100000:1.0:1787574216.242756:0:8510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874407290077184:0@lo:104: 00000100:00100000:2.0:1787574216.243035:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574216.243068:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290077440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574216.243103:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574216.243138:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574216.243144:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290077312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574216.243185:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574216.243221:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272224384 00000100:00100000:2.0:1787574216.243226:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272224384 00010000:00010000:2.0:1787574216.243248:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a1d2abc00/0xfe91058e646bf74b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea27 expref: 10 pid: 5824 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574216.243269:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290077440 00000100:00100000:2.0:1787574216.243272:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290077440 00010000:00010000:2.0:1787574216.243284:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a00031200/0xfe91058e646bf561 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf55a expref: 18 pid: 5823 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574216.243295:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290077312 00000100:00100000:2.0:1787574216.243297:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290077312 00010000:00010000:2.0:1787574216.243309:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a00030000/0xfe91058e646bf5c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf5bc expref: 19 pid: 5823 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574216.243321:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:2.0:1787574216.243328:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05293b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9891405-66e8-4ae2-851e-6434ae47d085+10:2350:x1874407272224384:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574216.243338:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574216.243343:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a1d2abc00/0xfe91058e646bf74b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea27 expref: 10 pid: 5824 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574216.243354:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a1d2abc00/0xfe91058e646bf74b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea27 expref: 10 pid: 5824 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574216.243368:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574216.243409:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05293b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9891405-66e8-4ae2-851e-6434ae47d085+10:2350:x1874407272224384:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 82us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574216.243417:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:2.0:1787574216.243430:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787574216.243435:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05292680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+19:3301:x1874407290077440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574216.243450:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574216.243454:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a00031200/0xfe91058e646bf561 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf55a expref: 19 pid: 5823 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574216.243463:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a00031200/0xfe91058e646bf561 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf55a expref: 19 pid: 5823 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574216.243473:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a00031200/0xfe91058e646bf561 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf55a expref: 19 pid: 5823 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574216.243484:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574216.243508:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05292680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+18:3301:x1874407290077440:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574216.243514:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787574216.243525:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787574216.243530:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05290e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+17:3301:x1874407290077312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574216.243536:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574216.243540:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a00030000/0xfe91058e646bf5c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf5bc expref: 17 pid: 5823 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574216.243548:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a00030000/0xfe91058e646bf5c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf5bc expref: 17 pid: 5823 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574216.243557:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a00030000/0xfe91058e646bf5c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf5bc expref: 17 pid: 5823 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574216.243569:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7ec lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574216.243577:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7ec lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574216.243598:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7ec lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574216.243606:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7ec lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574216.243613:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7ec lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574216.243621:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7ec lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574216.243626:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a42045e00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574216.243631:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7ec lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574216.243638:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7ec lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574216.243645:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7ec lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574216.243662:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574216.243682:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05290e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+16:3301:x1874407290077312:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574216.243689:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787574216.243788:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290077312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574216.243810:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290077440:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787574216.244012:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574216.244156:0:8510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a1d2abc00/0xfe91058e646bf74b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea27 expref: 9 pid: 5824 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574216.244218:0:8510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874407290076672:192.168.206.51@tcp:104: 00010000:00010000:1.0:1787574216.244242:0:8510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7ec lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574216.244260:0:8510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7ec lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574216.244267:0:8510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7ec lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574216.244274:0:8510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7ec lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574216.245334:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290077056:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574216.434202:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574216.608336:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574216.608455:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272224512 00000100:00100000:1.0:1787574216.608468:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272224512 00000100:00100000:1.0:1787574216.608531:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 170 00000100:00100000:1.0:1787574216.608543:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+9:5591:x1874407272224512:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574216.608563:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574216.608589:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ea66 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574216.608623:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea66 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574216.608635:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea66 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574216.608645:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a42045e00, rc 0) 00000100:00100000:1.0:1787574216.608713:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+10:5591:x1874407272224512:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 172us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574216.608721:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 170 00000100:00100000:2.0:1787574216.617896:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574216.622048:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272224640 00000100:00100000:3.0:1787574216.622066:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272224640 00000100:00100000:2.0:1787574216.626985:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 171 00000100:00100000:2.0:1787574216.627003:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+10:5591:x1874407272224640:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574216.627379:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+10:5591:x1874407272224640:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 379us (9496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574216.627388:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 171 00000100:00100000:2.0:1787574216.631040:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574216.631141:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272224768 00000100:00100000:3.0:1787574216.631154:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272224768 00000100:00100000:3.0:1787574216.631451:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 172 00000100:00100000:3.0:1787574216.631461:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+10:5591:x1874407272224768:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574216.631693:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+10:5591:x1874407272224768:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 233us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574216.631702:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 172 00000100:00100000:0.0:1787574216.643820:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574216.645550:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272224896 00000100:00100000:3.0:1787574216.645568:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272224896 00000100:00100000:3.0:1787574216.645637:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 173 00000100:00100000:3.0:1787574216.645648:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+10:6127:x1874407272224896:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787574216.646760:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+10:6127:x1874407272224896:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 1106us (2948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574216.646774:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 173 00000100:00100000:2.0:1787574216.652160:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574216.652527:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272225024 00000100:00100000:3.0:1787574216.652541:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272225024 00000100:00100000:3.0:1787574216.652614:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 174 00000100:00100000:3.0:1787574216.652627:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+10:6127:x1874407272225024:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787574216.652964:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+10:6127:x1874407272225024:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 338us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574216.652973:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 174 00010000:00010000:0.0:1787574217.457419:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574217.842135:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290077568:0@lo:400:kworker.0 00000100:00100000:1.0:1787574217.842245:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574217.842294:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290078080:0@lo:400:kworker.0 00000100:00100000:1.0:1787574217.842325:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574217.842352:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787574217.842357:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290077696:0@lo:400:kworker.0 00000100:00100000:1.0:1787574217.842380:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574217.842399:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290078208:0@lo:400:kworker.0 00000100:00100000:1.0:1787574217.842423:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574217.842452:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290077824:0@lo:400:kworker.0 00000100:00100000:1.0:1787574217.842475:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574217.842510:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574217.842519:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290077952:0@lo:400:kworker.0 00000100:00100000:1.0:1787574217.842543:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574217.842654:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290078080 00000100:00100000:0.0:1787574217.842668:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290078080 00000100:00100000:0.0:1787574217.842734:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290077696 00000100:00100000:0.0:1787574217.842738:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290077696 00000100:00100000:0.0:1787574217.842755:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290077824 00000100:00100000:0.0:1787574217.842757:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290077824 00000100:00100000:0.0:1787574217.842775:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787574217.842792:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290078080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574217.842934:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290078080:12345-0@lo:400:kworker.0 Request processed in 135us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574217.842942:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787574217.842959:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787574217.842965:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290077696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574217.842993:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290077696:12345-0@lo:400:kworker.0 Request processed in 29us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574217.843000:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787574217.843010:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787574217.843016:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290077824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574217.843040:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290077824:12345-0@lo:400:kworker.0 Request processed in 25us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574217.843045:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787574217.843064:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290077568 00000100:00100000:0.0:1787574217.843068:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290077568 00000100:00100000:0.0:1787574217.843093:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787574217.843099:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+16:3298:x1874407290077568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574217.843125:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+16:3298:x1874407290077568:12345-0@lo:400:kworker.0 Request processed in 27us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574217.843131:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:0.0:1787574217.843158:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574217.843246:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290077696:0@lo:400:kworker.0 00000100:00100000:3.0:1787574217.843263:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290077568:0@lo:400:kworker.0 00000100:00100000:3.0:1787574217.843276:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290078080:0@lo:400:kworker.0 00000100:00100000:1.0:1787574217.843570:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290077824:0@lo:400:kworker.0 00000100:00100000:0.0:1787574217.843592:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290078208 00000100:00100000:0.0:1787574217.843598:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290078208 00000100:00100000:0.0:1787574217.843638:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290077952 00000100:00100000:0.0:1787574217.843642:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290077952 00000100:00100000:0.0:1787574217.843670:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787574217.843685:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290078208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574217.843889:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787574217.843898:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290077952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574217.843934:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290078208:12345-0@lo:400:kworker.0 Request processed in 250us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574217.843945:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290077952:12345-0@lo:400:kworker.0 Request processed in 46us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574217.843945:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787574217.843956:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787574217.843999:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574217.844002:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787574217.844106:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41d3c000 x1874407290077952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574217.844119:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290077952:0@lo:400:kworker.0 00010000:00080000:1.0:1787574217.844155:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41d3fb80 x1874407290078208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574217.844195:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290078208:0@lo:400:kworker.0 10000000:01000000:1.0:1787574218.099457:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787574218.099464:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982a3a5c3000 from 4 10000000:01000000:1.0:1787574218.099469:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787574218.099509:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42044a00/0xfe91058e646bf7fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574218.099520:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a42044a00/0xfe91058e646bf7fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574218.099531:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a42044a00/0xfe91058e646bf7fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574218.099554:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290078336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787574218.099629:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574218.099682:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0805f780 going to sleep for 11 seconds 00000100:00100000:2.0:1787574218.099988:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290078336 00000100:00100000:2.0:1787574218.099995:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290078336 00000100:00100000:2.0:1787574218.100080:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787574218.100089:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+16:5827:x1874407290078336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574218.100102:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574218.100115:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a1d2abc00/0xfe91058e646bf801 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf7fa expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574218.100135:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a1d2abc00/0xfe91058e646bf801 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf7fa expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574218.100145:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a1d2abc00/0xfe91058e646bf801 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf7fa expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574218.100153:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a1d2abc00, rc 0) 00000100:00100000:2.0:1787574218.100216:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290078336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574218.100223:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787574218.100304:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290078336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574218.100318:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a42044a00/0xfe91058e646bf7fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf801 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574218.100327:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a42044a00/0xfe91058e646bf7fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf801 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574218.100391:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290078464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574218.100417:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574218.113710:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0805f780 going to sleep for 11 seconds 00000100:00100000:0.0:1787574218.116846:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290078464 00000100:00100000:0.0:1787574218.116860:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290078464 00000100:00100000:0.0:1787574218.116920:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787574218.116930:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290078464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574218.117290:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290078464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 361us (16871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574218.117298:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787574218.117830:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290078464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574218.117881:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290078592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574218.117933:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574218.117973:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a07df6000 going to sleep for 11 seconds 00000100:00100000:0.0:1787574218.118020:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290078592 00000100:00100000:0.0:1787574218.118026:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290078592 00000100:00100000:0.0:1787574218.118113:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787574218.118124:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290078592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574218.118782:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290078592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 659us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574218.118789:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787574218.118943:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290078592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574218.124248:0:8611:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8611:1874407290078720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574218.124330:0:8611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574218.124374:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290078720 00000100:00100000:3.0:1787574218.124380:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290078720 00000100:00100000:3.0:1787574218.124921:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787574218.124930:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a10091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+17:8611:x1874407290078720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574218.125310:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a10091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+17:8611:x1874407290078720:12345-0@lo:502:llog_process_th.0 Request processed in 379us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574218.125318:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787574218.125371:0:8611:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a07df6180 going to sleep for 11 seconds 00000100:00100000:3.0:1787574218.125448:0:8611:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8611:1874407290078720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787574218.125478:0:8611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574218.125491:0:8611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574218.125493:0:8611:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787574218.125499:0:8611:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982a3a5c3000 00000020:00000080:3.0:1787574218.125501:0:8611:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787574218.130529:0:8611:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05291f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8611:1874407290078848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574218.130829:0:8611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574218.130884:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290078848 00000100:00100000:2.0:1787574218.130891:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290078848 00000100:00100000:2.0:1787574218.130943:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787574218.131085:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a10093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+17:8611:x1874407290078848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574218.131374:0:8611:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574218.131852:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a10093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+17:8611:x1874407290078848:12345-0@lo:502:llog_process_th.0 Request processed in 899us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574218.131862:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787574218.132155:0:8611:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05291f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8611:1874407290078848:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787574218.132209:0:8611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574218.132218:0:8611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574218.132221:0:8611:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787574218.132225:0:8611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787574218.132546:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787574218.132572:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787574218.132582:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42044a00/0xfe91058e646bf7fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf801 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574218.132593:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a42044a00/0xfe91058e646bf7fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf801 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574218.132603:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787574218.132605:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982a41658000 from 4 10000000:01000000:2.0:1787574218.132608:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787574218.132635:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab800/0xfe91058e646bf808 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574218.132643:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab800/0xfe91058e646bf808 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574218.132662:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab800/0xfe91058e646bf808 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574218.132681:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05291180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290078976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787574218.132745:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574218.132782:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b6480 going to sleep for 11 seconds 00000100:00100000:3.0:1787574218.132875:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290078976 00000100:00100000:3.0:1787574218.132882:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290078976 00000100:00100000:3.0:1787574218.132923:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787574218.132930:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a10093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290078976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574218.132943:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574218.132954:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a027f2c00/0xfe91058e646bf80f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf808 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574218.132975:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a027f2c00/0xfe91058e646bf80f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf808 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574218.132997:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a027f2c00/0xfe91058e646bf80f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf808 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574218.133005:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a027f2c00, rc 0) 00000100:00100000:3.0:1787574218.133053:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a10093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290078976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574218.133069:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787574218.133347:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05291180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290078976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574218.133360:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab800/0xfe91058e646bf808 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf80f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574218.133369:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab800/0xfe91058e646bf808 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf80f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574218.133425:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290079104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574218.133464:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574218.133487:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a05009cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574218.133730:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290079104 00000100:00100000:2.0:1787574218.133734:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290079104 00000100:00100000:2.0:1787574218.133767:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787574218.133775:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290079104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574218.135073:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290079104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1176us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574218.135084:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787574218.135341:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290079104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574218.135503:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290079232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574218.135548:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574218.135580:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a05009cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574218.138398:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290079232 00000100:00100000:1.0:1787574218.138418:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290079232 00000100:00100000:1.0:1787574218.138479:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787574218.138490:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290079232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574218.138752:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290079232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 264us (3203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574218.138760:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787574218.138934:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290079232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574218.139304:0:8615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8615:1874407290079360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574218.139350:0:8615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574218.139384:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290079360 00000100:00100000:2.0:1787574218.139389:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290079360 00000100:00100000:3.0:1787574218.139404:0:8615:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a05009540 going to sleep for 11 seconds 00000100:00100000:2.0:1787574218.139435:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787574218.141530:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:8615:x1874407290079360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574218.141886:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:8615:x1874407290079360:12345-0@lo:502:llog_process_th.0 Request processed in 368us (2535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574218.141896:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787574218.141984:0:8615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8615:1874407290079360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787574218.142758:0:8615:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574218.142770:0:8615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574218.142773:0:8615:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787574218.142781:0:8615:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982a41658000 00000020:00000080:2.0:1787574218.142784:0:8615:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787574218.144410:0:8615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8615:1874407290079488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574218.144492:0:8615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574218.144546:0:8615:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a07df6000 going to sleep for 11 seconds 00000100:00100000:1.0:1787574218.145038:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290079488 00000100:00100000:1.0:1787574218.145048:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290079488 00000100:00100000:1.0:1787574218.145292:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787574218.145303:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+18:8615:x1874407290079488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574218.145558:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+18:8615:x1874407290079488:12345-0@lo:502:llog_process_th.0 Request processed in 257us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574218.145566:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787574218.149518:0:8615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8615:1874407290079488:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787574218.149560:0:8615:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574218.149575:0:8615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574218.149578:0:8615:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787574218.149583:0:8615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787574218.159734:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787574218.159772:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787574218.159783:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab800/0xfe91058e646bf808 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf80f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574218.159796:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab800/0xfe91058e646bf808 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf80f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574218.159982:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787574218.159986:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982a0622a800 from 4 10000000:01000000:0.0:1787574218.159995:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787574218.160033:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf816 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574218.160041:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf816 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574218.160776:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf816 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574218.160807:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a2ff03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290079616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787574218.160876:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574218.160926:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a1697d540 going to sleep for 11 seconds 00000100:00100000:3.0:1787574218.162554:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290079616 00000100:00100000:3.0:1787574218.162565:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290079616 00000100:00100000:3.0:1787574218.162695:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787574218.162705:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290079616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574218.162730:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574218.162747:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a027f2000/0xfe91058e646bf81d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf816 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574218.162770:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a027f2000/0xfe91058e646bf81d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf816 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574218.162779:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a027f2000/0xfe91058e646bf81d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf816 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574218.162787:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a027f2000, rc 0) 00000100:00100000:3.0:1787574218.162849:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290079616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (1974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574218.162865:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787574218.162915:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a2ff03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290079616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574218.162931:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf816 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf81d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574218.162940:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf816 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf81d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574218.162996:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290079744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574218.163023:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574218.163046:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290079744 00000100:00100000:3.0:1787574218.163050:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290079744 00000100:00100000:3.0:1787574218.167712:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787574218.167741:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290079744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574218.168041:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290079744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 306us (5016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574218.168049:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787574218.178302:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a07df6180 going to sleep for 11 seconds 00000100:00100000:1.0:1787574218.178346:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290079744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574218.178414:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290079872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574218.178489:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574218.178534:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290079872 00000100:00100000:1.0:1787574218.178540:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290079872 00000100:00100000:1.0:1787574218.178586:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787574218.179133:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290079872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574218.179350:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290079872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 755us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574218.179358:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787574218.179470:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0805f840 going to sleep for 11 seconds 00000100:00100000:1.0:1787574218.179485:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290079872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574218.183334:0:8619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8619:1874407290080000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574218.183540:0:8619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574218.183582:0:8619:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056aa840 going to sleep for 11 seconds 00000100:00100000:1.0:1787574218.183857:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290080000 00000100:00100000:1.0:1787574218.183865:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290080000 00000100:00100000:1.0:1787574218.183914:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787574218.183923:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:8619:x1874407290080000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574218.184924:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:8619:x1874407290080000:12345-0@lo:502:llog_process_th.0 Request processed in 999us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574218.184934:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787574218.185005:0:8619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8619:1874407290080000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787574218.185034:0:8619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574218.185046:0:8619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574218.185048:0:8619:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787574218.186806:0:8619:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982a0622a800 00000020:00000080:1.0:1787574218.186813:0:8619:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787574218.186908:0:8619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8619:1874407290080128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574218.186973:0:8619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574218.187011:0:8619:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0805fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574218.188854:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290080128 00000100:00100000:3.0:1787574218.188867:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290080128 00000100:00100000:3.0:1787574218.188932:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787574218.188943:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:8619:x1874407290080128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574218.189224:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:8619:x1874407290080128:12345-0@lo:502:llog_process_th.0 Request processed in 283us (2250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574218.189236:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787574218.190269:0:8619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:8619:1874407290080128:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787574218.190307:0:8619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574218.190315:0:8619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574218.190318:0:8619:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787574218.190322:0:8619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787574218.190398:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787574218.190418:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787574218.190427:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf816 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf81d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574218.190438:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf816 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf81d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574218.353514:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787574218.353539:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290080256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574218.353633:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574218.353793:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290080256 00000100:00100000:3.0:1787574218.353800:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290080256 00000100:00100000:3.0:1787574218.353848:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787574218.353857:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290080256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787574218.353903:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787574218.353958:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290080256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574218.353964:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787574218.354089:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a05293800 x1874407290080256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574218.354107:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290080256:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787574218.481502:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574218.523437:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574218.523478:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574218.523513:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574218.523541:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574218.523576:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272225536 00000100:00100000:3.0:1787574218.523584:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272225536 00000100:00100000:3.0:1787574218.523639:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272225408 00000100:00100000:3.0:1787574218.523643:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272225408 00000100:00100000:3.0:1787574218.523668:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:3.0:1787574218.523683:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2351:x1874407272225536:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574218.523756:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2351:x1874407272225536:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 74us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574218.523764:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:3.0:1787574218.523778:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:3.0:1787574218.523784:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2351:x1874407272225408:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574218.523807:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2351:x1874407272225408:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 23us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574218.523828:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00080000:3.0:1787574218.523845:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787574218.523849:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787574218.524340:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272225280 00000100:00100000:0.0:1787574218.524345:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272225280 00000100:00100000:0.0:1787574218.524399:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:0.0:1787574218.524408:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2351:x1874407272225280:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574218.524448:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2351:x1874407272225280:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 42us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574218.524454:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:1.0:1787574218.524580:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272225152 00000100:00100000:1.0:1787574218.524584:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272225152 00000100:00100000:1.0:1787574218.524620:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 191 00000100:00100000:1.0:1787574218.524627:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+10:2351:x1874407272225152:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574218.524659:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+10:2351:x1874407272225152:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 32us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574218.524665:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 191 00000100:00080000:2.0:1787574218.538654:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574219.378032:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574219.378055:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290080384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574219.378127:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574219.378227:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290080384 00000100:00100000:2.0:1787574219.378234:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290080384 00000100:00100000:2.0:1787574219.378293:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787574219.378302:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290080384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574219.378335:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787574219.378375:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290080384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574219.378383:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787574219.378402:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787574219.378428:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a05291880 x1874407290080384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574219.378444:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290080384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787574219.505537:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574220.529481:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574221.558977:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787574222.223604:0:8810:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1787574222.577559:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574222.969788:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a2ff00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290080640:0@lo:400:kworker.0 00000100:00100000:0.0:1787574222.969873:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574222.969934:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a2ff00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290081152:0@lo:400:kworker.0 00000100:00100000:0.0:1787574222.969961:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574222.969996:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787574222.970002:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a2ff02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290080512:0@lo:400:kworker.0 00000100:00100000:0.0:1787574222.970032:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574222.970051:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a2ff03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874407290081024:0@lo:400:kworker.0 00000100:00100000:0.0:1787574222.970074:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574222.970099:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a2ff01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290080768:0@lo:400:kworker.0 00000100:00100000:0.0:1787574222.970126:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574222.970145:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574222.970151:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a2ff01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290080896:0@lo:400:kworker.0 00000100:00100000:0.0:1787574222.970273:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574222.970311:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290080640 00000100:00100000:0.0:1787574222.970320:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290080640 00000100:00100000:1.0:1787574222.970547:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290080512 00000100:00100000:1.0:1787574222.970552:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290080512 00000100:00100000:1.0:1787574222.970588:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787574222.970599:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a03487050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:3299:x1874407290080512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574222.970666:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a03487050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:3299:x1874407290080512:12345-0@lo:400:kworker.0 Request processed in 68us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574222.970674:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787574222.971128:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290081024 00000100:00100000:0.0:1787574222.971133:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290081024 00000100:00080000:1.0:1787574222.971228:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574222.974545:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290080768 00000100:00100000:3.0:1787574222.974560:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290080768 00000100:00100000:3.0:1787574222.974638:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787574222.974652:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290080640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574222.974771:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290080640:12345-0@lo:400:kworker.0 Request processed in 121us (4899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574222.974780:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787574222.974801:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787574222.974809:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874407290081024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574222.974843:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874407290081024:12345-0@lo:400:kworker.0 Request processed in 35us (4768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574222.974850:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787574222.974862:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787574222.974868:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290080768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574222.974911:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290080768:12345-0@lo:400:kworker.0 Request processed in 43us (4783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574222.974917:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1787574222.974977:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574222.975045:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a2ff01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290080768:0@lo:400:kworker.0 00000100:00100000:2.0:1787574222.975457:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290081152 00000100:00100000:2.0:1787574222.975463:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290081152 00000100:00100000:2.0:1787574222.975508:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290080896 00000100:00100000:2.0:1787574222.975512:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290080896 00000100:00100000:2.0:1787574222.975537:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787574222.975544:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290081152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574222.975591:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290081152:12345-0@lo:400:kworker.0 Request processed in 48us (5629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574222.975598:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787574222.975611:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787574222.975617:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290080896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574222.975649:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290080896:12345-0@lo:400:kworker.0 Request processed in 32us (5376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574222.975671:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1787574222.975727:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a2ff01180 x1874407290080896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574222.975740:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a2ff01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290080896:0@lo:400:kworker.0 00000100:00100000:0.0:1787574222.975893:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a2ff02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290080512:0@lo:400:kworker.0 00000100:00100000:0.0:1787574222.975908:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a2ff03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874407290081024:0@lo:400:kworker.0 00000100:00100000:0.0:1787574222.975920:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a2ff00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290080640:0@lo:400:kworker.0 00010000:00080000:0.0:1787574222.975931:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a2ff00380 x1874407290081152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574222.975939:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a2ff00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290081152:0@lo:400:kworker.0 00000100:00080000:1.0:1787574222.981425:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787574222.981437:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787574223.474490:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290081280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574223.474576:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574223.474920:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290081280 00000100:00100000:2.0:1787574223.474930:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290081280 00000100:00100000:2.0:1787574223.474995:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787574223.475007:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290081280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787574223.475051:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787574223.475117:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290081280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574223.475125:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787574223.476196:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a05291880 x1874407290081280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574223.476226:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290081280:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787574223.604047:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574223.650031:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574223.650072:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574223.650114:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574223.650157:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574223.650217:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272225920 00000100:00100000:2.0:1787574223.650229:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272225920 00000100:00100000:1.0:1787574223.650235:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272225792 00000100:00100000:1.0:1787574223.650242:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272225792 00000100:00100000:2.0:1787574223.650306:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272226048 00000100:00100000:2.0:1787574223.650310:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272226048 00000100:00100000:0.0:1787574223.650311:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272225664 00000100:00100000:0.0:1787574223.650318:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272225664 00000100:00100000:0.0:1787574223.650355:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 193 00000100:00100000:0.0:1787574223.650368:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a03484050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+10:2350:x1874407272225664:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574223.650376:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:3.0:1787574223.650390:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2350:x1874407272225920:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574223.650453:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a03484050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+10:2350:x1874407272225664:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 86us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574223.650454:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2350:x1874407272225920:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 66us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574223.650471:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 193 00000100:00100000:3.0:1787574223.650472:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:1.0:1787574223.657216:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:1.0:1787574223.657242:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2350:x1874407272225792:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574223.657377:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2350:x1874407272225792:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 146us (7261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574223.657387:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:2.0:1787574223.661115:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:2.0:1787574223.661137:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2350:x1874407272226048:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574223.661287:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2350:x1874407272226048:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 159us (11129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574223.661295:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00080000:3.0:1787574223.661568:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787574223.661579:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787574223.661583:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574224.502849:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290081408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574224.502923:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574224.503073:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290081408 00000100:00100000:2.0:1787574224.503082:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290081408 00000100:00100000:2.0:1787574224.503157:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787574224.503188:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290081408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574224.503222:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787574224.503290:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574224.518692:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290081408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 15507us (15749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574224.518707:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787574224.519030:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41f70a80 x1874407290081408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574224.519054:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290081408:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787574224.628548:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574225.650891:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574226.674483:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787574227.121703:0:9053:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing yml_node 00010000:00010000:0.0:1787574227.697626:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574228.083151:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290081664:0@lo:400:kworker.0 00000100:00100000:3.0:1787574228.083285:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574228.083336:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290082176:0@lo:400:kworker.0 00000100:00100000:3.0:1787574228.083362:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574228.083392:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787574228.083398:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290081536:0@lo:400:kworker.0 00000100:00100000:3.0:1787574228.083423:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574228.083443:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874407290082048:0@lo:400:kworker.0 00000100:00100000:3.0:1787574228.083464:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574228.083491:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290081792:0@lo:400:kworker.0 00000100:00100000:3.0:1787574228.083515:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574228.083534:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574228.083539:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290081920:0@lo:400:kworker.0 00000100:00100000:3.0:1787574228.083561:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574228.083591:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290082176 00000100:00100000:3.0:1787574228.083598:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290082176 00000100:00100000:3.0:1787574228.083649:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290081920 00000100:00100000:3.0:1787574228.083652:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290081920 00000100:00100000:2.0:1787574228.083658:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787574228.083679:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290082176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574228.083699:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787574228.083705:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290081920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574228.083731:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290082176:12345-0@lo:400:kworker.0 Request processed in 55us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574228.083735:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290081920:12345-0@lo:400:kworker.0 Request processed in 30us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574228.083738:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787574228.083741:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787574228.083763:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290081536 00000100:00100000:3.0:1787574228.083766:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290081536 00000100:00100000:3.0:1787574228.083802:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787574228.083809:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a03485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:3299:x1874407290081536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574228.083840:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a03485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:3299:x1874407290081536:12345-0@lo:400:kworker.0 Request processed in 32us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574228.083871:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290081664 00000100:00100000:1.0:1787574228.083877:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290081664 00000100:00100000:1.0:1787574228.083956:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290082048 00000100:00100000:1.0:1787574228.083965:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290082048 00000100:00100000:3.0:1787574228.084094:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787574228.084143:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290081792 00000100:00100000:2.0:1787574228.084148:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290081792 00000100:00100000:2.0:1787574228.084192:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787574228.084200:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290081664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574228.084235:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290081664:12345-0@lo:400:kworker.0 Request processed in 37us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574228.084242:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787574228.084256:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787574228.084262:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874407290082048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574228.084566:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787574228.084574:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874407290082048:12345-0@lo:400:kworker.0 Request processed in 311us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574228.084579:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290081792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574228.084587:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787574228.084623:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290081792:12345-0@lo:400:kworker.0 Request processed in 49us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574228.084630:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787574228.087226:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574228.087234:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574228.087237:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574228.087275:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290081536:0@lo:400:kworker.0 00000100:00100000:2.0:1787574228.087431:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874407290082048:0@lo:400:kworker.0 00000100:00100000:2.0:1787574228.087447:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290081664:0@lo:400:kworker.0 00010000:00080000:2.0:1787574228.087460:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41d85500 x1874407290082176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574228.087471:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290082176:0@lo:400:kworker.0 00010000:00080000:3.0:1787574228.088839:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41d84700 x1874407290081920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574228.089635:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290081920:0@lo:400:kworker.0 00000100:00100000:3.0:1787574228.089659:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290081792:0@lo:400:kworker.0 00000100:00100000:3.0:1787574228.606679:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290082304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574228.607501:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574228.609592:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290082304 00000100:00100000:0.0:1787574228.609609:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290082304 00000100:00100000:0.0:1787574228.609687:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787574228.609699:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290082304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787574228.609744:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574228.609841:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290082304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (2342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574228.609849:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787574228.610950:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419daa00 x1874407290082304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574228.610989:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290082304:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787574228.721430:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574228.769927:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574228.769988:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574228.770022:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574228.770068:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574228.770204:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272226176 00000100:00100000:0.0:1787574228.770218:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272226176 00000100:00100000:0.0:1787574228.770300:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 195 00000100:00100000:0.0:1787574228.770311:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+10:2351:x1874407272226176:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574228.770350:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272226432 00000100:00100000:3.0:1787574228.770357:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272226432 00000100:00100000:3.0:1787574228.770399:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272226560 00000100:00100000:0.0:1787574228.770400:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+10:2351:x1874407272226176:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 90us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574228.770403:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272226560 00000100:00100000:0.0:1787574228.770425:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 195 00000100:00100000:3.0:1787574228.770456:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:3.0:1787574228.770467:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2349:x1874407272226432:12345-192.168.206.51@tcp:9:kworker.0 00000020:00000080:3.0:1787574228.770503:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf759 00000100:00080000:3.0:1787574228.770513:0:6682:0:(import.c:65:import_set_state_nolock()) ffff982906b88800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787574228.770559:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:0.0:1787574228.770617:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574228.770633:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:0.0:1787574228.770642:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2349:x1874407272226560:12345-192.168.206.51@tcp:9:kworker.0 00000020:00000080:0.0:1787574228.770674:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf760 00000100:00080000:0.0:1787574228.770681:0:6681:0:(import.c:65:import_set_state_nolock()) ffff982a07868000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787574228.770710:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787574228.771062:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+2:2349:x1874407272226560:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 421us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574228.771074:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:3.0:1787574228.771075:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+2:2349:x1874407272226432:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 607us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574228.771085:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:2.0:1787574228.771784:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272226304 00000100:00100000:2.0:1787574228.771794:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272226304 00000100:00100000:2.0:1787574228.771862:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:2.0:1787574228.771872:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2351:x1874407272226304:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574228.771919:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2351:x1874407272226304:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 50us (2009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574228.771937:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00080000:2.0:1787574228.771958:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574228.771963:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787574228.771965:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787574228.772092:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574229.619548:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290082432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574229.619647:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574229.619874:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290082432 00000100:00100000:1.0:1787574229.619886:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290082432 00000100:00100000:1.0:1787574229.619958:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787574229.619970:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290082432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574229.620019:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787574229.622732:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290082432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2751us (3073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574229.622749:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1787574229.624849:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41d86a00 x1874407290082432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574229.624883:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290082432:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787574229.749074:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787574230.752017:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f 00000020:00000080:2.0:1787574230.752030:0:6706:0:(genops.c:885:class_export_put()) final put ffff982906b8d000/a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f 00000020:00000080:0.0:1787574230.752122:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982906b8d000/a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f for lustre-OST0000 00000020:00000080:0.0:1787574230.752203:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982906b88800 for lustre-OST0000 00010000:00010000:2.0:1787574230.773986:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787574230.781105:0:9247:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.80 00010000:00010000:0.0:1787574231.797843:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574232.817439:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787574233.118556:0:9344:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.80 00000100:00100000:2.0:1787574233.213991:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290082560:0@lo:400:kworker.0 00000100:00100000:2.0:1787574233.214082:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574233.214127:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290083072:0@lo:400:kworker.0 00000100:00100000:2.0:1787574233.214154:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574233.214197:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787574233.214203:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290082688:0@lo:400:kworker.0 00000100:00100000:2.0:1787574233.214224:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574233.214240:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290083200:0@lo:400:kworker.0 00000100:00100000:2.0:1787574233.214263:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574233.215704:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290082560 00000100:00100000:3.0:1787574233.215715:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290082560 00000100:00100000:3.0:1787574233.215777:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787574233.215786:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290082560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574233.215853:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290082560:12345-0@lo:400:kworker.0 Request processed in 69us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574233.215860:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787574233.215891:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290083072 00000100:00100000:3.0:1787574233.215894:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290083072 00000100:00100000:3.0:1787574233.215925:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290082688 00000100:00100000:3.0:1787574233.215927:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290082688 00000100:00100000:3.0:1787574233.215944:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787574233.215949:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290083072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574233.215976:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290083072:12345-0@lo:400:kworker.0 Request processed in 27us (1822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574233.215982:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787574233.215991:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787574233.215996:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290082688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574233.216015:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290082688:12345-0@lo:400:kworker.0 Request processed in 20us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574233.216031:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1787574233.216048:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574233.216506:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290082560:0@lo:400:kworker.0 00000100:00100000:2.0:1787574233.216522:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290083072:0@lo:400:kworker.0 00000100:00100000:2.0:1787574233.216548:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290082688:0@lo:400:kworker.0 00000100:00100000:2.0:1787574233.216573:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290082816:0@lo:400:kworker.0 00000100:00100000:2.0:1787574233.216606:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574233.216626:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574233.216644:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290082944:0@lo:400:kworker.0 00000100:00100000:2.0:1787574233.216669:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574233.216695:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290082816 00000100:00100000:2.0:1787574233.216699:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290082816 00000100:00100000:3.0:1787574233.216710:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290083200 00000100:00100000:3.0:1787574233.216713:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290083200 00000100:00100000:3.0:1787574233.216796:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290082944 00000100:00100000:3.0:1787574233.216799:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290082944 00000100:00100000:3.0:1787574233.216823:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787574233.216830:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290083200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574233.216837:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787574233.216843:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290082816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574233.216869:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290083200:12345-0@lo:400:kworker.0 Request processed in 39us (2605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574233.216870:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290082816:12345-0@lo:400:kworker.0 Request processed in 28us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574233.216875:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787574233.216876:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787574233.216888:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787574233.216893:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290082944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574233.216917:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290082944:12345-0@lo:400:kworker.0 Request processed in 25us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574233.216923:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787574233.216936:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787574233.216938:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787574233.216940:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787574233.217286:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a05291880 x1874407290083200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574233.217297:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290083200:0@lo:400:kworker.0 00010000:00080000:2.0:1787574233.221117:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a05291500 x1874407290082944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574233.221144:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290082944:0@lo:400:kworker.0 00000100:00100000:2.0:1787574233.221161:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290082816:0@lo:400:kworker.0 00000001:00100000:3.0:1787574233.300983:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f 00000020:00000080:3.0:1787574233.300992:0:7648:0:(genops.c:885:class_export_put()) final put ffff982a0786e800/a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f 00000020:00000080:3.0:1787574233.301206:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982a0786e800/a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f for lustre-OST0001 00000020:00000080:3.0:1787574233.301255:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982a07868000 for lustre-OST0001 00000100:00100000:3.0:1787574233.713318:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574233.713506:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290083328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574233.713581:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574233.717579:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290083328 00000100:00100000:2.0:1787574233.717594:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290083328 00000100:00100000:2.0:1787574233.717702:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787574233.717714:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290083328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787574233.717759:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787574233.717846:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290083328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (4264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574233.717852:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1787574233.717923:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41d84a80 x1874407290083328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574233.717942:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290083328:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787574233.841422:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574233.880751:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574233.882076:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272226688 00000100:00100000:3.0:1787574233.882094:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272226688 00000100:00100000:3.0:1787574233.882209:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 197 00000100:00100000:3.0:1787574233.882225:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+10:2350:x1874407272226688:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574233.882333:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+10:2350:x1874407272226688:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 113us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574233.882342:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 197 00000100:00100000:2.0:1787574233.895582:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574233.897004:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272226816 00000100:00100000:0.0:1787574233.897016:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272226816 00000100:00100000:0.0:1787574233.897098:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:0.0:1787574233.897108:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2351:x1874407272226816:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574233.897209:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2351:x1874407272226816:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 102us (1637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574233.897218:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00080000:3.0:1787574233.897440:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574234.737525:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290083456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574234.737600:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574234.737962:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290083456 00000100:00100000:3.0:1787574234.737971:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290083456 00000100:00100000:3.0:1787574234.738126:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787574234.738136:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290083456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787574234.738196:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787574234.738252:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290083456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574234.738260:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787574234.739976:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41d84a80 x1874407290083456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574234.740000:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290083456:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787574234.869514:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787574235.549292:0:9443:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.80 00010000:00010000:0.0:1787574235.891597:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574236.922233:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787574237.234846:0:9493:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 24 08:23:55 EDT 2026 00010000:00010000:0.0:1787574237.937849:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574238.327461:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290083712:0@lo:400:kworker.0 00000100:00100000:1.0:1787574238.327466:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290083584:0@lo:400:kworker.0 00000100:00100000:0.0:1787574238.328896:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574238.328965:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290084224:0@lo:400:kworker.0 00000100:00100000:3.0:1787574238.328972:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290083712 00000100:00100000:3.0:1787574238.328988:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290083712 00000100:00100000:0.0:1787574238.328998:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574238.329070:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290084224 00000100:00100000:3.0:1787574238.329080:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787574238.329080:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290084224 00000100:00100000:3.0:1787574238.329100:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290083712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574238.329150:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787574238.329186:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290084224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574238.329346:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290083840:0@lo:400:kworker.0 00000100:00100000:0.0:1787574238.329438:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290084224:12345-0@lo:400:kworker.0 Request processed in 278us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574238.329446:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1787574238.329468:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787574238.329497:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41f6d880 x1874407290084224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574238.329511:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290084224:0@lo:400:kworker.0 00000100:00100000:0.0:1787574238.330270:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290083968:0@lo:400:kworker.0 00000100:00100000:0.0:1787574238.330310:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574238.330358:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290083968 00000100:00100000:0.0:1787574238.330365:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290083968 00000100:00100000:0.0:1787574238.330401:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787574238.330410:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290083968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574238.330453:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290083968:12345-0@lo:400:kworker.0 Request processed in 44us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574238.330459:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1787574238.330478:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787574238.331036:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419daa00 x1874407290083968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574238.331051:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290083968:0@lo:400:kworker.0 00000100:00100000:1.0:1787574238.331632:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574238.331719:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290083840 00000100:00100000:1.0:1787574238.331725:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290083840 00000100:00100000:1.0:1787574238.331771:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787574238.331780:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290083840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574238.331823:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290083840:12345-0@lo:400:kworker.0 Request processed in 44us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574238.331830:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1787574238.331863:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574238.331895:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574238.331938:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290084096:0@lo:400:kworker.0 00000100:00100000:1.0:1787574238.331969:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574238.332007:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290083584 00000100:00100000:1.0:1787574238.332011:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290083584 00000100:00100000:1.0:1787574238.332044:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787574238.332053:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290083584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574238.332108:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290083584:12345-0@lo:400:kworker.0 Request processed in 56us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574238.332117:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787574238.332155:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290084096 00000100:00100000:1.0:1787574238.332159:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290084096 00000100:00100000:1.0:1787574238.332213:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787574238.332222:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290084096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574238.332256:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290084096:12345-0@lo:400:kworker.0 Request processed in 36us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574238.332262:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1787574238.332277:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574238.332292:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290083584:0@lo:400:kworker.0 00000100:00100000:1.0:1787574238.332303:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290084096:0@lo:400:kworker.0 00000100:00100000:1.0:1787574238.332390:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290083840:0@lo:400:kworker.0 00000100:00100000:3.0:1787574238.339923:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290083712:12345-0@lo:400:kworker.0 Request processed in 10812us (11014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574238.339943:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787574238.340041:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290083712:0@lo:400:kworker.0 00000100:00100000:3.0:1787574238.840537:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290084352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574238.840630:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574238.840707:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290084352 00000100:00100000:3.0:1787574238.840715:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290084352 00000100:00100000:3.0:1787574238.840768:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787574238.840777:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290084352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787574238.840814:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787574238.840859:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290084352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574238.840867:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1787574238.840908:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41d87b80 x1874407290084352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574238.840928:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290084352:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787574238.963202:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574239.003343:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574239.003388:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574239.003421:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272227072 00000100:00100000:0.0:1787574239.003431:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272227072 00000100:00100000:0.0:1787574239.003496:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:0.0:1787574239.003507:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2353:x1874407272227072:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574239.003584:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2353:x1874407272227072:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 81us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574239.003592:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00080000:0.0:1787574239.003630:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574239.003841:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272226944 00000100:00100000:3.0:1787574239.003846:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272226944 00000100:00100000:3.0:1787574239.003885:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 199 00000100:00100000:3.0:1787574239.003893:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+10:2353:x1874407272226944:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574239.003921:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+10:2353:x1874407272226944:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 29us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574239.003934:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 199 00000100:00100000:1.0:1787574239.858185:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290084480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574239.858257:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574239.858329:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290084480 00000100:00100000:1.0:1787574239.858336:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290084480 00000100:00100000:1.0:1787574239.858382:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787574239.858392:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290084480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574239.858425:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787574239.858470:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290084480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574239.858476:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787574239.858526:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41d3ed80 x1874407290084480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574239.858543:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290084480:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787574239.986008:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574241.019767:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574242.034491:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574243.067545:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574243.442536:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290084608:0@lo:400:kworker.0 00000100:00100000:2.0:1787574243.442641:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574243.443138:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290084608 00000100:00100000:1.0:1787574243.443149:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290084608 00000100:00100000:1.0:1787574243.443225:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787574243.443237:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290084608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574243.449131:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290084736:0@lo:400:kworker.0 00000100:00100000:1.0:1787574243.449284:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290084608:12345-0@lo:400:kworker.0 Request processed in 6045us (6638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574243.449285:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290084608:0@lo:400:kworker.0 00000100:00100000:1.0:1787574243.449304:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787574243.452192:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574243.452424:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290084736 00000100:00100000:2.0:1787574243.452440:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290084736 00000100:00100000:2.0:1787574243.452532:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787574243.452543:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290084736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574243.452669:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290084736:12345-0@lo:400:kworker.0 Request processed in 128us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574243.452677:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787574243.452751:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290084736:0@lo:400:kworker.0 00000100:00100000:3.0:1787574243.452809:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290084864:0@lo:400:kworker.0 00000100:00100000:3.0:1787574243.452876:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574243.452959:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290084992:0@lo:400:kworker.0 00000100:00100000:3.0:1787574243.453015:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574243.453050:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290084864 00000100:00100000:2.0:1787574243.453058:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290084864 00000100:00100000:0.0:1787574243.453068:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290084992 00000100:00100000:0.0:1787574243.453077:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290084992 00000100:00100000:2.0:1787574243.453145:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787574243.453150:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787574243.453160:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290084864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574243.453192:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290084992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574243.453403:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290084864:12345-0@lo:400:kworker.0 Request processed in 247us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574243.453410:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787574243.453447:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290084864:0@lo:400:kworker.0 00000100:00100000:2.0:1787574243.453491:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290085248:0@lo:400:kworker.0 00000100:00100000:2.0:1787574243.453527:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574243.453555:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787574243.453563:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874407290085120:0@lo:400:kworker.0 00000100:00100000:0.0:1787574243.453611:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290084992:12345-0@lo:400:kworker.0 Request processed in 451us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574243.453620:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787574243.453652:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574243.453682:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290085248 00000100:00100000:2.0:1787574243.453686:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290085248 00000100:00100000:2.0:1787574243.453717:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787574243.453724:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290085248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574243.453759:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290085248:12345-0@lo:400:kworker.0 Request processed in 37us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574243.453766:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1787574243.453803:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a3a6cca80 x1874407290085248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574243.453815:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290085248:0@lo:400:kworker.0 00000100:00100000:2.0:1787574243.453832:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290085120 00000100:00100000:2.0:1787574243.453842:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290085120 00000100:00100000:2.0:1787574243.453869:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787574243.453876:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874407290085120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574243.453919:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874407290085120:12345-0@lo:400:kworker.0 Request processed in 44us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574243.453927:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787574243.453953:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874407290085120:0@lo:400:kworker.0 00000100:00080000:3.0:1787574243.454420:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787574243.454430:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787574243.454437:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787574243.454497:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41d87b80 x1874407290084992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574243.454516:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290084992:0@lo:400:kworker.0 00000100:00100000:0.0:1787574243.955800:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787574243.955830:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290085376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574243.955920:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574243.956113:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290085376 00000100:00100000:1.0:1787574243.956125:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290085376 00000100:00100000:1.0:1787574243.956431:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787574243.956442:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290085376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574243.956502:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787574243.956566:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290085376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574243.956588:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1787574243.956847:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a3a6cf480 x1874407290085376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574243.956870:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290085376:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787574244.082515:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574244.120624:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574244.120686:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574244.120804:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272227328 00000100:00100000:3.0:1787574244.120815:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272227328 00000100:00100000:3.0:1787574244.120896:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:3.0:1787574244.120908:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2352:x1874407272227328:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574244.120998:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2352:x1874407272227328:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 92us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574244.121005:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00080000:2.0:1787574244.121070:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574244.121336:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272227200 00000100:00100000:2.0:1787574244.121341:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272227200 00000100:00100000:2.0:1787574244.121383:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 201 00000100:00100000:2.0:1787574244.121391:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+10:2352:x1874407272227200:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574244.121427:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+10:2352:x1874407272227200:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 37us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574244.121435:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 201 00000100:00100000:0.0:1787574244.978654:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290085504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574244.978757:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574244.978895:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290085504 00000100:00100000:3.0:1787574244.978905:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290085504 00000100:00100000:3.0:1787574244.978969:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787574244.978981:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290085504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787574244.979027:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787574244.979096:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290085504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574244.979117:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787574244.979520:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a3a6cfb80 x1874407290085504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574244.979542:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290085504:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787574245.107311:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574246.130367:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574247.154377:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574248.177543:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574248.566947:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290085632:0@lo:400:kworker.0 00000100:00100000:1.0:1787574248.566950:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290085888:0@lo:400:kworker.0 00000100:00100000:2.0:1787574248.567097:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290085760:0@lo:400:kworker.0 00000100:00100000:0.0:1787574248.567218:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290086016:0@lo:400:kworker.0 00000100:00100000:1.0:1787574248.576329:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574248.576436:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290085888 00000100:00100000:1.0:1787574248.576445:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290085888 00000100:00100000:1.0:1787574248.576512:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787574248.576535:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290085888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574248.576606:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290085888:12345-0@lo:400:kworker.0 Request processed in 74us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574248.576613:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1787574248.576633:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574248.576664:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290085888:0@lo:400:kworker.0 00000100:00100000:3.0:1787574248.579442:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574248.579528:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290086144:0@lo:400:kworker.0 00000100:00100000:3.0:1787574248.579629:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574248.579702:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290085632 00000100:00100000:3.0:1787574248.579712:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290085632 00000100:00100000:3.0:1787574248.579774:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787574248.579785:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290085632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574248.579845:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290085632:12345-0@lo:400:kworker.0 Request processed in 62us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574248.579852:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787574248.579886:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290086144 00000100:00100000:3.0:1787574248.579890:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290086144 00000100:00100000:3.0:1787574248.579929:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787574248.579936:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290086144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574248.579971:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290086144:12345-0@lo:400:kworker.0 Request processed in 35us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574248.579977:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787574248.580017:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290085632:0@lo:400:kworker.0 00000100:00100000:3.0:1787574248.580030:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290086144:0@lo:400:kworker.0 00000100:00080000:1.0:1787574248.581801:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574248.584243:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574248.584297:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290086272:0@lo:400:kworker.0 00000100:00100000:2.0:1787574248.584343:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574248.584384:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290086272 00000100:00100000:2.0:1787574248.584391:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290086272 00000100:00100000:1.0:1787574248.584409:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290085760 00000100:00100000:1.0:1787574248.584413:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290085760 00000100:00100000:2.0:1787574248.584443:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787574248.584443:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787574248.584451:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290085760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574248.584453:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290086272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574248.584517:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290086272:12345-0@lo:400:kworker.0 Request processed in 66us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574248.584524:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787574248.584546:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787574248.584586:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a0355c700 x1874407290086272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574248.584600:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290086272:0@lo:400:kworker.0 00000100:00100000:1.0:1787574248.584603:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290085760:12345-0@lo:400:kworker.0 Request processed in 153us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574248.584609:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787574248.584638:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290085760:0@lo:400:kworker.0 00000100:00100000:0.0:1787574248.585473:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574248.586010:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290086016 00000100:00100000:2.0:1787574248.586017:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290086016 00000100:00100000:2.0:1787574248.586062:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787574248.586073:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290086016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574248.586125:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290086016:12345-0@lo:400:kworker.0 Request processed in 55us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574248.586131:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787574248.586148:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787574248.586281:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41d3c380 x1874407290086016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574248.586294:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290086016:0@lo:400:kworker.0 00000100:00100000:1.0:1787574249.075849:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290086400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574249.075932:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574249.081246:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290086400 00000100:00100000:0.0:1787574249.081261:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290086400 00000100:00100000:0.0:1787574249.081314:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787574249.081330:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290086400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787574249.081615:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574249.081690:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290086400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 362us (5758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574249.081697:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787574249.083124:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419db800 x1874407290086400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574249.083148:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290086400:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787574249.202188:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574249.243630:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574249.243683:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574249.243715:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272227584 00000100:00100000:0.0:1787574249.243723:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272227584 00000100:00100000:0.0:1787574249.243785:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:0.0:1787574249.243796:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2350:x1874407272227584:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574249.243863:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2350:x1874407272227584:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 68us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574249.243870:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00080000:0.0:1787574249.243890:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574249.244877:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272227456 00000100:00100000:3.0:1787574249.244885:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272227456 00000100:00100000:3.0:1787574249.244936:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 203 00000100:00100000:3.0:1787574249.244945:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+10:2350:x1874407272227456:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574249.245374:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+10:2350:x1874407272227456:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 430us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574249.245382:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 203 00000100:00100000:2.0:1787574250.099460:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290086528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574250.099529:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574250.099644:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290086528 00000100:00100000:1.0:1787574250.099652:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290086528 00000100:00100000:1.0:1787574250.099712:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787574250.099722:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290086528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574250.099755:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787574250.099803:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290086528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574250.099821:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787574250.099861:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a0355c700 x1874407290086528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574250.099880:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290086528:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787574250.099981:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787574250.225451:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574251.253610:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574252.273384:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574253.302341:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574253.682402:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290086656:0@lo:400:kworker.0 00000100:00100000:0.0:1787574253.682489:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574253.682554:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290087168:0@lo:400:kworker.0 00000100:00100000:0.0:1787574253.682597:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574253.682630:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787574253.682637:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290086784:0@lo:400:kworker.0 00000100:00100000:0.0:1787574253.682659:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574253.682679:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290087296:0@lo:400:kworker.0 00000100:00100000:0.0:1787574253.682705:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574253.682732:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290086912:0@lo:400:kworker.0 00000100:00100000:0.0:1787574253.682771:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574253.682793:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574253.682800:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290087040:0@lo:400:kworker.0 00000100:00100000:0.0:1787574253.682824:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574253.682866:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290087168 00000100:00100000:0.0:1787574253.682874:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290087168 00000100:00100000:0.0:1787574253.682933:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290086784 00000100:00100000:0.0:1787574253.682936:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290086784 00000100:00100000:0.0:1787574253.682950:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290086912 00000100:00100000:0.0:1787574253.682952:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290086912 00000100:00100000:0.0:1787574253.682987:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787574253.683000:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290087168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574253.683059:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290087168:12345-0@lo:400:kworker.0 Request processed in 63us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574253.683068:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787574253.683087:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787574253.683093:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290086784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574253.683121:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290086784:12345-0@lo:400:kworker.0 Request processed in 29us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574253.683128:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787574253.683141:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787574253.683148:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290086912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574253.683208:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290086912:12345-0@lo:400:kworker.0 Request processed in 61us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574253.683215:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787574253.683271:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290086912:0@lo:400:kworker.0 00000100:00100000:0.0:1787574253.683459:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290086784:0@lo:400:kworker.0 00000100:00100000:0.0:1787574253.683468:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290087168:0@lo:400:kworker.0 00000100:00100000:2.0:1787574253.687080:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290086656 00000100:00100000:3.0:1787574253.687451:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290087296 00000100:00100000:3.0:1787574253.687462:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290087296 00000100:00100000:3.0:1787574253.687545:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290087040 00000100:00100000:3.0:1787574253.687549:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290087040 00000100:00100000:3.0:1787574253.687590:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787574253.687603:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290087296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574253.687717:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290087296:12345-0@lo:400:kworker.0 Request processed in 117us (5010us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574253.687725:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787574253.687747:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787574253.687753:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290087040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574253.687786:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290087040:12345-0@lo:400:kworker.0 Request processed in 33us (4962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574253.687792:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1787574253.687959:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41c1aa00 x1874407290087040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574253.688051:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290086656 00000100:00100000:2.0:1787574253.688098:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787574253.688106:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290086656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574253.688145:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290086656:12345-0@lo:400:kworker.0 Request processed in 41us (5658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574253.688297:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290087040:0@lo:400:kworker.0 00010000:00080000:0.0:1787574253.688344:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41c1b480 x1874407290087296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574253.688354:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290087296:0@lo:400:kworker.0 00000100:00100000:0.0:1787574253.688366:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290086656:0@lo:400:kworker.0 00000100:00100000:2.0:1787574253.688533:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:2.0:1787574253.688568:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574253.688572:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787574253.688575:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1787574254.100578:0:10124:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:24:12 (1787574252) === 00000100:00100000:3.0:1787574254.197811:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290087424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574254.197887:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574254.197971:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290087424 00000100:00100000:3.0:1787574254.197978:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290087424 00000100:00100000:3.0:1787574254.198027:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787574254.198036:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290087424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787574254.198074:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787574254.198132:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290087424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574254.198154:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1787574254.198571:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a3a6cce00 x1874407290087424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574254.198591:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290087424:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787574254.325750:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574254.363385:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574254.363430:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574254.363463:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272227712 00000100:00100000:2.0:1787574254.363472:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272227712 00000100:00100000:2.0:1787574254.363535:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 205 00000100:00100000:2.0:1787574254.363545:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+10:2350:x1874407272227712:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574254.363610:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+10:2350:x1874407272227712:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 67us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574254.363617:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 205 00000100:00100000:1.0:1787574254.367280:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272227840 00000100:00100000:1.0:1787574254.367293:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272227840 00000100:00100000:1.0:1787574254.367366:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:1.0:1787574254.367376:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2350:x1874407272227840:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574254.367453:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2350:x1874407272227840:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 78us (4023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574254.367462:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00080000:3.0:1787574254.367807:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574254.664540:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574254.664674:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272227968 00000100:00100000:0.0:1787574254.664684:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272227968 00000100:00100000:0.0:1787574254.664796:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 206 00000100:00100000:0.0:1787574254.664807:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+10:8130:x1874407272227968:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787574254.664823:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574254.664840:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a00030000/0xfe91058e646bf824 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ea6d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574254.664868:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a00030000/0xfe91058e646bf824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea6d expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574254.664880:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a00030000/0xfe91058e646bf824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea6d expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574254.664891:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a00030000, rc 0) 00000100:00100000:0.0:1787574254.664968:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+11:8130:x1874407272227968:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 162us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574254.664975:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 206 00000100:00100000:0.0:1787574254.671835:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574254.673091:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272228096 00000100:00100000:2.0:1787574254.673110:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272228096 00000100:00100000:2.0:1787574254.673228:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 207 00000100:00100000:2.0:1787574254.673242:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+11:8130:x1874407272228096:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787574254.674221:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+11:8130:x1874407272228096:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 973us (2391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574254.674235:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 207 00000100:00100000:3.0:1787574254.680716:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574254.681104:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272228224 00000100:00100000:0.0:1787574254.681114:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272228224 00000100:00100000:3.0:1787574254.681443:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 208 00000100:00100000:3.0:1787574254.681456:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+11:8130:x1874407272228224:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787574254.681700:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+11:8130:x1874407272228224:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 246us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574254.681709:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 208 00000100:00100000:0.0:1787574254.711777:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574254.712135:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272228352 00000100:00100000:2.0:1787574254.712145:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272228352 00000100:00100000:2.0:1787574254.712324:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 209 00000100:00100000:2.0:1787574254.712338:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+11:8134:x1874407272228352:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787574254.712881:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+11:8134:x1874407272228352:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 546us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574254.712890:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 209 00000100:00100000:0.0:1787574254.729643:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574254.729800:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272228480 00000100:00100000:3.0:1787574254.729810:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272228480 00000100:00100000:3.0:1787574254.729870:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 210 00000100:00100000:3.0:1787574254.729881:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+11:8134:x1874407272228480:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787574254.730372:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+11:8134:x1874407272228480:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 491us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574254.730381:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 210 00000100:00100000:3.0:1787574254.744740:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574254.745296:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272228608 00000100:00100000:2.0:1787574254.745307:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272228608 00000100:00100000:2.0:1787574254.745430:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 211 00000100:00100000:2.0:1787574254.745442:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+11:8130:x1874407272228608:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787574254.745459:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574254.745477:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a1d2ab200/0xfe91058e646bf82b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ea97 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574254.745505:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a1d2ab200/0xfe91058e646bf82b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea97 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574254.745527:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a1d2ab200/0xfe91058e646bf82b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea97 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574254.745537:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a1d2ab200, rc 0) 00000100:00100000:2.0:1787574254.745605:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+12:8130:x1874407272228608:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 165us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574254.745612:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 211 00000100:00100000:0.0:1787574254.754841:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574254.755013:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272228736 00000100:00100000:3.0:1787574254.755024:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272228736 00000100:00100000:3.0:1787574254.755082:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 212 00000100:00100000:3.0:1787574254.755093:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04966c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+12:8130:x1874407272228736:12345-192.168.206.51@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787574254.755118:0:5824:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787574254.755150:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787574254.755155:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787574254.755158:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787574254.755161:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787574254.760464:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04966c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+12:8130:x1874407272228736:12345-192.168.206.51@tcp:256:mount.lustre.0 Request processed in 5360us (5621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574254.760479:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 212 00000100:00100000:2.0:1787574254.772345:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574254.781134:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272228864 00000100:00100000:3.0:1787574254.781156:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272228864 00000100:00100000:2.0:1787574254.782088:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 213 00000100:00100000:2.0:1787574254.782105:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04965450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+12:8130:x1874407272228864:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787574254.782126:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574254.782148:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a1d2aaa00/0xfe91058e646bf832 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ea9e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574254.782228:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a1d2aaa00/0xfe91058e646bf832 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea9e expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574254.782241:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a1d2aaa00/0xfe91058e646bf832 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea9e expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574254.782252:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a1d2aaa00, rc 0) 00000100:00100000:2.0:1787574254.784176:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04965450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+13:8130:x1874407272228864:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 2046us (11815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574254.784189:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 213 00000100:00100000:2.0:1787574254.807449:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574254.807553:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272228992 00000100:00100000:3.0:1787574254.807566:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272228992 00000100:00100000:3.0:1787574254.807631:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 214 00000100:00100000:3.0:1787574254.807644:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04967450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:8130:x1874407272228992:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787574254.808199:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04967450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:8130:x1874407272228992:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 513us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574254.808213:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 214 00000100:00100000:0.0:1787574254.818936:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574254.819098:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272229120 00000100:00100000:2.0:1787574254.819108:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272229120 00000100:00100000:2.0:1787574254.819159:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 215 00000100:00100000:2.0:1787574254.819198:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+13:8130:x1874407272229120:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787574254.819822:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+13:8130:x1874407272229120:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 625us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574254.819832:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 215 00000100:00100000:2.0:1787574254.823285:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574254.823902:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272229248 00000100:00100000:3.0:1787574254.823912:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272229248 00000100:00100000:3.0:1787574254.823968:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 216 00000100:00100000:3.0:1787574254.823978:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:8139:x1874407272229248:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787574254.824262:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:8139:x1874407272229248:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 284us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574254.824271:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 216 00000100:00100000:0.0:1787574254.831010:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574254.831202:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272229376 00000100:00100000:2.0:1787574254.831222:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272229376 00000100:00100000:2.0:1787574254.831279:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 217 00000100:00100000:2.0:1787574254.831290:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04965c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+13:8139:x1874407272229376:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787574254.831607:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04965c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+13:8139:x1874407272229376:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 317us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574254.831627:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 217 00000100:00100000:2.0:1787574254.842607:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574254.842668:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574254.842831:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272229888 00000100:00100000:3.0:1787574254.842840:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272229888 00000100:00100000:3.0:1787574254.842910:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272229504 00000100:00100000:3.0:1787574254.842914:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272229504 00000100:00100000:3.0:1787574254.842936:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:3.0:1787574254.842962:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2350:x1874407272229888:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574254.843033:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2350:x1874407272229888:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 74us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574254.843041:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:3.0:1787574254.843058:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:3.0:1787574254.843063:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2349:x1874407272229504:12345-192.168.206.51@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787574254.843084:0:5831:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f782322b-3b13-413b-a1b9-4500fa873ef8@192.168.206.51@tcp t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:3.0:1787574254.843121:0:5831:0:(genops.c:1385:class_connect()) connect: client f782322b-3b13-413b-a1b9-4500fa873ef8, cookie 0xfe91058e646bf839 00000004:00100000:3.0:1787574254.843151:0:5831:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787574254.843610:0:5831:0:(import.c:65:import_set_state_nolock()) ffff982a07897800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574254.850466:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+6:2349:x1874407272229504:12345-192.168.206.51@tcp:38:mount.lustre.0 Request processed in 7386us (7782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574254.850480:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:2.0:1787574254.869230:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574254.869275:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574254.869409:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272229760 00000100:00100000:0.0:1787574254.869421:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272229760 00000100:00100000:0.0:1787574254.869486:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272229632 00000100:00100000:0.0:1787574254.869489:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272229632 00000100:00100000:0.0:1787574254.869510:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:0.0:1787574254.869532:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f782322b-3b13-413b-a1b9-4500fa873ef8+7:8130:x1874407272229760:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787574254.869580:0:7646:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787574254.869666:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f782322b-3b13-413b-a1b9-4500fa873ef8+7:8130:x1874407272229760:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 136us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574254.869674:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:0.0:1787574254.869703:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:0.0:1787574254.869711:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f782322b-3b13-413b-a1b9-4500fa873ef8+6:0:x1874407272229632:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787574254.869723:0:7646:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787574254.869747:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f782322b-3b13-413b-a1b9-4500fa873ef8+6:0:x1874407272229632:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 38us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574254.869753:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00080000:3.0:1787574254.870263:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574254.876469:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574254.876604:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272230016 00000100:00100000:2.0:1787574254.876614:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272230016 00000100:00100000:2.0:1787574254.876680:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:2.0:1787574254.876692:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f782322b-3b13-413b-a1b9-4500fa873ef8+6:8130:x1874407272230016:12345-192.168.206.51@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787574254.876966:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f782322b-3b13-413b-a1b9-4500fa873ef8+6:8130:x1874407272230016:12345-192.168.206.51@tcp:40:mount.lustre.0 Request processed in 275us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574254.876976:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:0.0:1787574254.889148:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574254.889485:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574254.889536:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574254.889719:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272230144 00000100:00100000:3.0:1787574254.889728:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272230144 00000100:00100000:3.0:1787574254.889772:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272230272 00000100:00100000:3.0:1787574254.889775:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272230272 00000100:00100000:3.0:1787574254.889797:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1787574254.889805:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1874407272230144:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787574254.889834:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f782322b-3b13-413b-a1b9-4500fa873ef8@192.168.206.51@tcp t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:3.0:1787574254.889870:0:6681:0:(genops.c:1385:class_connect()) connect: client f782322b-3b13-413b-a1b9-4500fa873ef8, cookie 0xfe91058e646bf840 00002000:00100000:3.0:1787574254.889882:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f782322b-3b13-413b-a1b9-4500fa873ef8/ffff982a07894000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787574254.889921:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787574254.890190:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787574254.890222:0:6681:0:(import.c:65:import_set_state_nolock()) ffff982a07892000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787574254.890303:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f782322b-3b13-413b-a1b9-4500fa873ef8+6:2349:x1874407272230144:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 480us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574254.890324:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1787574254.890342:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:3.0:1787574254.890347:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1874407272230272:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787574254.890375:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f782322b-3b13-413b-a1b9-4500fa873ef8@192.168.206.51@tcp t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:3.0:1787574254.890395:0:6681:0:(genops.c:1385:class_connect()) connect: client f782322b-3b13-413b-a1b9-4500fa873ef8, cookie 0xfe91058e646bf847 00002000:00100000:3.0:1787574254.890401:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f782322b-3b13-413b-a1b9-4500fa873ef8/ffff982a07892800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787574254.890408:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787574254.890550:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787574254.890567:0:6681:0:(import.c:65:import_set_state_nolock()) ffff982a07895800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787574254.890593:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f782322b-3b13-413b-a1b9-4500fa873ef8+6:2349:x1874407272230272:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 244us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574254.890600:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1787574254.893849:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272230400 00000100:00100000:1.0:1787574254.893864:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272230400 00000100:00100000:2.0:1787574254.898662:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:2.0:1787574254.898677:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f782322b-3b13-413b-a1b9-4500fa873ef8+6:8130:x1874407272230400:12345-192.168.206.51@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787574254.899472:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787574254.899656:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f782322b-3b13-413b-a1b9-4500fa873ef8+6:8130:x1874407272230400:12345-192.168.206.51@tcp:33:mount.lustre.0 Request processed in 979us (10516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574254.899664:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:0.0:1787574255.217508:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574255.217542:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290087552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574255.217614:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574255.219877:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290087552 00000100:00100000:1.0:1787574255.219890:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290087552 00000100:00100000:1.0:1787574255.219984:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787574255.219995:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290087552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574255.220018:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787574255.220097:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290087552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (2482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574255.220106:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787574255.220387:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787574255.220471:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a0355c700 x1874407290087552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574255.220492:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290087552:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787574255.345782:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787574256.333416:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f782322b-3b13-413b-a1b9-4500fa873ef8 00010000:00010000:0.0:1787574256.371543:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574257.398793:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574258.426337:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574258.802127:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290087808:0@lo:400:kworker.0 00000100:00100000:2.0:1787574258.802926:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574258.802986:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290088320:0@lo:400:kworker.0 00000100:00100000:2.0:1787574258.803014:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574258.804994:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290087680:0@lo:400:kworker.0 00000100:00100000:0.0:1787574258.805056:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574258.805107:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290087936:0@lo:400:kworker.0 00000100:00100000:0.0:1787574258.805136:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574258.805194:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290087808 00000100:00100000:0.0:1787574258.805201:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290087808 00000100:00100000:0.0:1787574258.805244:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290087936 00000100:00100000:0.0:1787574258.805248:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290087936 00000100:00100000:0.0:1787574258.805694:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787574258.805703:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290087808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574258.805755:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290087808:12345-0@lo:400:kworker.0 Request processed in 54us (2832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574258.805762:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787574258.805776:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787574258.805781:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290087936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574258.805825:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290087936:12345-0@lo:400:kworker.0 Request processed in 43us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574258.805831:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1787574258.805852:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574258.806017:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290087680 00000100:00100000:1.0:1787574258.806022:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290087680 00000100:00100000:1.0:1787574258.806056:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787574258.806062:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04964050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290087680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574258.806106:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04964050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290087680:12345-0@lo:400:kworker.0 Request processed in 45us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574258.806112:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787574258.806115:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290087808:0@lo:400:kworker.0 00000100:00100000:2.0:1787574258.806200:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290088064:0@lo:400:kworker.0 00000100:00100000:2.0:1787574258.806228:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574258.809995:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290087936:0@lo:400:kworker.0 00000100:00100000:0.0:1787574258.810108:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290087680:0@lo:400:kworker.0 00000100:00100000:0.0:1787574258.810119:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290088192:0@lo:400:kworker.0 00000100:00100000:0.0:1787574258.810200:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574258.810256:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290088192 00000100:00100000:0.0:1787574258.810261:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290088192 00000100:00100000:0.0:1787574258.810311:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787574258.810319:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290088192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574258.810365:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290088192:12345-0@lo:400:kworker.0 Request processed in 47us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574258.810371:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1787574258.810392:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574258.810410:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290088192:0@lo:400:kworker.0 00000100:00100000:2.0:1787574258.816641:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290088320 00000100:00100000:2.0:1787574258.816653:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290088320 00000100:00100000:2.0:1787574258.816703:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290088064 00000100:00100000:2.0:1787574258.816706:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290088064 00000100:00100000:2.0:1787574258.816726:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787574258.816735:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290088320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574258.816813:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290088320:12345-0@lo:400:kworker.0 Request processed in 79us (13798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574258.816820:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787574258.816833:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787574258.816838:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290088064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574258.816865:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290088064:12345-0@lo:400:kworker.0 Request processed in 27us (10636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574258.816871:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1787574258.816909:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a069ff480 x1874407290088064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574258.816924:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290088064:0@lo:400:kworker.0 00000100:00080000:2.0:1787574258.816947:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574258.816950:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787574258.816983:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a069fe680 x1874407290088320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574258.816992:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290088320:0@lo:400:kworker.0 00000001:00100000:2.0:1787574258.868728:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f782322b-3b13-413b-a1b9-4500fa873ef8 00000001:00100000:1.0:1787574258.878288:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f782322b-3b13-413b-a1b9-4500fa873ef8 00000100:00100000:2.0:1787574259.326320:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574259.326342:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290088448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574259.326417:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574259.326475:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290088448 00000100:00100000:2.0:1787574259.326482:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290088448 00000100:00100000:2.0:1787574259.326539:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787574259.326547:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290088448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787574259.326582:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787574259.326626:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290088448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574259.326633:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787574259.326672:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a069fe680 x1874407290088448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574259.326689:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290088448:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787574259.450939:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574259.996601:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574259.996638:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574259.996667:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574259.996701:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574259.996727:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574259.996752:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272230784 00000100:00100000:2.0:1787574259.996760:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272230784 00000100:00100000:2.0:1787574259.996809:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272230656 00000100:00100000:2.0:1787574259.996827:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272230656 00000100:00100000:2.0:1787574259.996850:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:2.0:1787574259.996859:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2353:x1874407272230784:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574259.996925:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2353:x1874407272230784:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 66us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574259.996932:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:2.0:1787574259.996947:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:2.0:1787574259.996953:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2353:x1874407272230656:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574259.996975:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2353:x1874407272230656:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 22us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574259.996981:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:2.0:1787574259.996998:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272231040 00000100:00100000:2.0:1787574259.997001:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272231040 00000100:00100000:2.0:1787574259.997023:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272230912 00000100:00100000:2.0:1787574259.997026:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272230912 00000100:00100000:2.0:1787574259.997042:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:2.0:1787574259.997049:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2353:x1874407272231040:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574259.997072:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2353:x1874407272231040:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574259.997078:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:2.0:1787574259.997089:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:2.0:1787574259.997094:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2353:x1874407272230912:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574259.997113:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2353:x1874407272230912:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 19us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574259.997127:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00080000:2.0:1787574259.997149:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574259.997778:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787574259.997907:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272230528 00000100:00100000:3.0:1787574259.997913:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272230528 00000100:00100000:3.0:1787574259.997957:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 219 00000100:00100000:3.0:1787574259.997966:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04964850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:2353:x1874407272230528:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574259.998014:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04964850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:2353:x1874407272230528:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 50us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574259.998021:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 219 00000100:00080000:1.0:1787574259.999351:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574260.338397:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574260.338422:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290088576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574260.338497:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574260.339561:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290088576 00000100:00100000:1.0:1787574260.339571:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290088576 00000100:00100000:1.0:1787574260.339650:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787574260.339660:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290088576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574260.339696:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787574260.339756:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290088576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574260.339763:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787574260.339802:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a0355e300 x1874407290088576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574260.339820:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290088576:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787574260.340015:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787574260.466192:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574261.491557:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574262.515018:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574263.539656:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787574263.636628:0:10323:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1787574263.931439:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290088704:0@lo:400:kworker.0 00000100:00100000:3.0:1787574263.931522:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574263.931567:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290089216:0@lo:400:kworker.0 00000100:00100000:3.0:1787574263.931595:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574263.931619:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787574263.931625:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290088832:0@lo:400:kworker.0 00000100:00100000:3.0:1787574263.931648:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574263.931664:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290089344:0@lo:400:kworker.0 00000100:00100000:3.0:1787574263.931688:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574263.931715:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290088960:0@lo:400:kworker.0 00000100:00100000:3.0:1787574263.931752:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574263.931847:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574263.931854:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290089088:0@lo:400:kworker.0 00000100:00100000:3.0:1787574263.931879:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574263.931911:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290088704 00000100:00100000:3.0:1787574263.931918:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290088704 00000100:00100000:3.0:1787574263.931960:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787574263.931970:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290088704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574263.932018:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290088704:12345-0@lo:400:kworker.0 Request processed in 49us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574263.932025:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787574263.932055:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290089216 00000100:00100000:3.0:1787574263.932059:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290089216 00000100:00100000:3.0:1787574263.932092:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290088832 00000100:00100000:3.0:1787574263.932095:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290088832 00000100:00100000:3.0:1787574263.932125:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290088960 00000100:00100000:3.0:1787574263.932128:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290088960 00000100:00100000:3.0:1787574263.936372:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787574263.936386:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290089216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574263.936482:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290089216:12345-0@lo:400:kworker.0 Request processed in 98us (4885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574263.936489:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787574263.936506:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787574263.936513:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290088832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574263.936545:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290088832:12345-0@lo:400:kworker.0 Request processed in 32us (4896us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574263.936551:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787574263.936563:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787574263.936569:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290088960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574263.936609:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290088960:12345-0@lo:400:kworker.0 Request processed in 40us (4855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574263.936614:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787574263.936642:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290089344 00000100:00100000:3.0:1787574263.936649:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290089344 00000100:00100000:3.0:1787574263.936681:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290089088 00000100:00100000:3.0:1787574263.936685:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290089088 00000100:00100000:3.0:1787574263.936705:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787574263.936711:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290089344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574263.936744:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290089344:12345-0@lo:400:kworker.0 Request processed in 33us (5055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574263.936750:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787574263.936760:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787574263.937942:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290089088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574263.937992:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290089088:12345-0@lo:400:kworker.0 Request processed in 55us (6112us total) trans 0 rc 0/0 00000100:00080000:2.0:1787574263.948794:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574263.948802:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787574263.948805:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574263.948855:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290088832:0@lo:400:kworker.0 00010000:00080000:2.0:1787574263.948873:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a3a6cdc00 x1874407290089344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574263.948884:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290089344:0@lo:400:kworker.0 00000100:00100000:2.0:1787574263.948894:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290088704:0@lo:400:kworker.0 00000100:00100000:2.0:1787574263.948905:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290089216:0@lo:400:kworker.0 00010000:00080000:2.0:1787574263.948961:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a3a6cd880 x1874407290089088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574263.948971:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290089088:0@lo:400:kworker.0 00000100:00100000:2.0:1787574263.948983:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290088960:0@lo:400:kworker.0 00000100:00100000:3.0:1787574263.949233:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787574264.433680:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574264.433702:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290089472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574264.433768:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574264.434516:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290089472 00000100:00100000:1.0:1787574264.434524:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290089472 00000100:00100000:1.0:1787574264.434577:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787574264.434588:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290089472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574264.434621:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787574264.434680:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290089472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574264.434688:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1787574264.435216:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a069ff100 x1874407290089472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574264.435238:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290089472:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787574264.565066:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574265.121484:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574265.121534:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574265.121583:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574265.121610:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574265.121633:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574265.121667:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272231680 00000100:00100000:0.0:1787574265.121679:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272231680 00000100:00100000:0.0:1787574265.121744:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272231552 00000100:00100000:0.0:1787574265.121747:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272231552 00000100:00100000:0.0:1787574265.121769:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:0.0:1787574265.121780:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2352:x1874407272231680:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574265.121864:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2352:x1874407272231680:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 86us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574265.121872:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:0.0:1787574265.121890:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:0.0:1787574265.121897:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2352:x1874407272231552:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574265.121920:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2352:x1874407272231552:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574265.121926:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:1.0:1787574265.122159:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272231168 00000100:00100000:1.0:1787574265.122189:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272231168 00000100:00100000:1.0:1787574265.122228:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 221 00000100:00100000:1.0:1787574265.122236:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+13:2352:x1874407272231168:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574265.122271:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+13:2352:x1874407272231168:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 36us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574265.122278:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 221 00000100:00100000:3.0:1787574265.122723:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272231424 00000100:00100000:3.0:1787574265.122730:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272231424 00000100:00100000:3.0:1787574265.122812:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272231296 00000100:00100000:3.0:1787574265.122816:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272231296 00000100:00100000:3.0:1787574265.122848:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:3.0:1787574265.122857:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2352:x1874407272231424:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574265.122919:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2352:x1874407272231424:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 63us (1385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574265.122926:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:3.0:1787574265.122940:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:3.0:1787574265.122947:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2352:x1874407272231296:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574265.122973:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2352:x1874407272231296:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 27us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574265.122979:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00080000:2.0:1787574265.123762:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574265.123769:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574265.123773:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574265.457396:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290089600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574265.457504:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574265.457628:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290089600 00000100:00100000:1.0:1787574265.457639:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290089600 00000100:00100000:1.0:1787574265.457721:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787574265.457732:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290089600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574265.457774:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787574265.457842:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290089600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574265.457850:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1787574265.457977:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787574265.458012:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a0355e300 x1874407290089600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574265.458035:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290089600:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787574265.587097:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574266.620257:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574267.633389:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574268.657483:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574269.043704:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290089856:0@lo:400:kworker.0 00000100:00100000:0.0:1787574269.043783:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574269.043830:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290090368:0@lo:400:kworker.0 00000100:00100000:0.0:1787574269.043859:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574269.043887:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787574269.043899:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41c1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290089728:0@lo:400:kworker.0 00000100:00100000:0.0:1787574269.043925:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574269.043945:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874407290090240:0@lo:400:kworker.0 00000100:00100000:0.0:1787574269.043974:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574269.043995:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290090112:0@lo:400:kworker.0 00000100:00100000:0.0:1787574269.044016:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574269.044030:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787574269.044035:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1874407290089984:0@lo:400:kworker.0 00000100:00100000:0.0:1787574269.044052:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574269.044382:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290090368 00000100:00100000:0.0:1787574269.044389:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290090368 00000100:00100000:0.0:1787574269.044446:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290090112 00000100:00100000:0.0:1787574269.044450:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290090112 00000100:00100000:0.0:1787574269.044474:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787574269.044482:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a14cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290090368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574269.044530:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a14cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290090368:12345-0@lo:400:kworker.0 Request processed in 49us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574269.044537:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787574269.044711:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787574269.044718:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290090112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574269.044748:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290090112:12345-0@lo:400:kworker.0 Request processed in 30us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574269.044753:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1787574269.044768:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574269.044771:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787574269.044798:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419d8e00 x1874407290090112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574269.044810:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290090112:0@lo:400:kworker.0 00010000:00080000:0.0:1787574269.044837:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419db800 x1874407290090368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574269.044853:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290090368:0@lo:400:kworker.0 00000100:00100000:2.0:1787574269.044956:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290089728 00000100:00100000:2.0:1787574269.044961:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290089728 00000100:00100000:2.0:1787574269.044996:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787574269.045002:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04966450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:3299:x1874407290089728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574269.045037:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04966450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:3299:x1874407290089728:12345-0@lo:400:kworker.0 Request processed in 35us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574269.045043:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787574269.045083:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41c1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290089728:0@lo:400:kworker.0 00000100:00100000:1.0:1787574269.046199:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290089856 00000100:00100000:1.0:1787574269.046208:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290089856 00000100:00100000:1.0:1787574269.046244:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290090240 00000100:00100000:1.0:1787574269.046247:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290090240 00000100:00100000:1.0:1787574269.046267:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290089984 00000100:00100000:1.0:1787574269.046269:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290089984 00000100:00100000:1.0:1787574269.046285:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787574269.046293:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290089856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574269.046356:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290089856:12345-0@lo:400:kworker.0 Request processed in 64us (2572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574269.046362:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787574269.046385:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787574269.046391:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874407290090240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574269.046419:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874407290090240:12345-0@lo:400:kworker.0 Request processed in 29us (2445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574269.046425:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787574269.046435:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787574269.046452:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874407290089984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574269.046483:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874407290089984:12345-0@lo:400:kworker.0 Request processed in 32us (2430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574269.046489:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787574269.046545:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874407290090240:0@lo:400:kworker.0 00000100:00100000:1.0:1787574269.046557:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290089856:0@lo:400:kworker.0 00000100:00080000:1.0:1787574269.046581:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574269.046853:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1874407290089984:0@lo:400:kworker.0 00000100:00100000:1.0:1787574269.553415:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574269.553451:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290090496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574269.553522:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574269.553654:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290090496 00000100:00100000:2.0:1787574269.553662:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290090496 00000100:00100000:2.0:1787574269.553714:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787574269.553724:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290090496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787574269.553759:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787574269.553809:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290090496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574269.553815:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1787574269.554211:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a069fe300 x1874407290090496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574269.554231:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290090496:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787574269.681393:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574270.236479:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574270.236531:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574270.236573:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574270.236597:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574270.236619:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574270.236815:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272232320 00000100:00100000:0.0:1787574270.236824:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272232320 00000100:00100000:0.0:1787574270.236875:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272232192 00000100:00100000:0.0:1787574270.236879:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272232192 00000100:00100000:0.0:1787574270.236904:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:0.0:1787574270.236926:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2353:x1874407272232320:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574270.236999:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2353:x1874407272232320:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 75us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574270.237007:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:0.0:1787574270.237026:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:0.0:1787574270.237033:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2353:x1874407272232192:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574270.237056:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2353:x1874407272232192:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574270.237062:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:0.0:1787574270.237082:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272232064 00000100:00100000:0.0:1787574270.237108:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272232064 00000100:00100000:0.0:1787574270.237138:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272231936 00000100:00100000:0.0:1787574270.237141:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272231936 00000100:00100000:0.0:1787574270.237162:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:0.0:1787574270.237213:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2353:x1874407272232064:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574270.237246:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2353:x1874407272232064:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 36us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574270.237251:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:0.0:1787574270.237263:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:3.0:1787574270.238295:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272231808 00000100:00100000:3.0:1787574270.238302:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272231808 00000100:00100000:3.0:1787574270.238337:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 223 00000100:00100000:3.0:1787574270.238345:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04965050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+13:2353:x1874407272231808:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574270.238383:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04965050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+13:2353:x1874407272231808:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 38us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574270.238415:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 223 00000100:00080000:1.0:1787574270.239624:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574270.239714:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2353:x1874407272231936:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574270.239775:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2353:x1874407272231936:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 2503us (3174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574270.239783:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00080000:2.0:1787574270.241826:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574270.241832:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787574270.578943:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290090624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574270.579007:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574270.579128:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290090624 00000100:00100000:3.0:1787574270.579135:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290090624 00000100:00100000:3.0:1787574270.579203:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787574270.579213:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290090624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787574270.579237:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787574270.579286:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290090624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574270.579292:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1787574270.584541:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a3a6cc380 x1874407290090624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574270.584588:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290090624:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787574270.705439:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574271.729364:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574272.753653:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574273.777377:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574274.164125:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290090752:0@lo:400:kworker.0 00000100:00100000:2.0:1787574274.164225:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574274.164267:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290091264:0@lo:400:kworker.0 00000100:00100000:2.0:1787574274.164291:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574274.164313:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787574274.164318:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290090880:0@lo:400:kworker.0 00000100:00100000:2.0:1787574274.164351:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574274.164366:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290091392:0@lo:400:kworker.0 00000100:00100000:2.0:1787574274.164385:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574274.164407:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290091008:0@lo:400:kworker.0 00000100:00100000:2.0:1787574274.164439:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574274.164455:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574274.164460:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290091136:0@lo:400:kworker.0 00000100:00100000:2.0:1787574274.164477:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574274.164504:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290091264 00000100:00100000:2.0:1787574274.164510:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290091264 00000100:00100000:2.0:1787574274.164551:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290090880 00000100:00100000:2.0:1787574274.164554:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290090880 00000100:00100000:2.0:1787574274.164564:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290091008 00000100:00100000:2.0:1787574274.164565:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290091008 00000100:00100000:2.0:1787574274.164578:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787574274.164586:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290091264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574274.164629:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290091264:12345-0@lo:400:kworker.0 Request processed in 44us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574274.164649:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787574274.164664:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787574274.164670:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290090880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574274.164693:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290090880:12345-0@lo:400:kworker.0 Request processed in 24us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574274.164699:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787574274.164707:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787574274.164712:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290091008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574274.164734:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290091008:12345-0@lo:400:kworker.0 Request processed in 23us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574274.164740:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1787574274.164758:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574274.164783:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290091008:0@lo:400:kworker.0 00000100:00100000:2.0:1787574274.164803:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290090880:0@lo:400:kworker.0 00000100:00100000:2.0:1787574274.164811:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290091264:0@lo:400:kworker.0 00000100:00100000:0.0:1787574274.165268:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290090752 00000100:00100000:0.0:1787574274.165275:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290090752 00000100:00100000:0.0:1787574274.165301:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787574274.165308:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04964c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290090752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574274.165361:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04964c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290090752:12345-0@lo:400:kworker.0 Request processed in 53us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574274.165367:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787574274.165394:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290091392 00000100:00100000:0.0:1787574274.165420:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290091392 00000100:00100000:0.0:1787574274.165448:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290091136 00000100:00100000:0.0:1787574274.165450:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290091136 00000100:00100000:0.0:1787574274.165477:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787574274.165483:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290091392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574274.165511:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290091392:12345-0@lo:400:kworker.0 Request processed in 28us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574274.165516:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787574274.165525:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787574274.165530:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290091136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574274.165553:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290091136:12345-0@lo:400:kworker.0 Request processed in 23us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574274.165558:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1787574274.167015:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574274.167023:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787574274.167063:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a069fed80 x1874407290091136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574274.167079:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290091136:0@lo:400:kworker.0 00010000:00080000:2.0:1787574274.167114:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a069fdf80 x1874407290091392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574274.167123:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290091392:0@lo:400:kworker.0 00000100:00100000:2.0:1787574274.167143:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290090752:0@lo:400:kworker.0 00000100:00100000:0.0:1787574274.673517:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290091520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574274.673592:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574274.673757:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290091520 00000100:00100000:2.0:1787574274.673766:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290091520 00000100:00100000:2.0:1787574274.673823:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787574274.673839:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290091520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787574274.673872:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787574274.674089:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290091520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 257us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574274.674096:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1787574274.674221:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a069fd500 x1874407290091520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574274.674238:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290091520:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787574274.801518:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574275.356115:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574275.356148:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574275.356194:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574275.356221:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574275.356308:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574275.356347:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272232832 00000100:00100000:0.0:1787574275.356361:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272232832 00000100:00100000:0.0:1787574275.356439:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272232960 00000100:00100000:0.0:1787574275.356443:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272232960 00000100:00100000:0.0:1787574275.356473:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:0.0:1787574275.356486:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2349:x1874407272232832:12345-192.168.206.51@tcp:9:kworker.0 00000020:00000080:0.0:1787574275.356523:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf840 00000100:00080000:0.0:1787574275.356534:0:6682:0:(import.c:65:import_set_state_nolock()) ffff982a07892000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787574275.356584:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787574275.356978:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+2:2349:x1874407272232832:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 493us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574275.357002:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:0.0:1787574275.357021:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:0.0:1787574275.357028:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2349:x1874407272232960:12345-192.168.206.51@tcp:9:kworker.0 00000020:00000080:0.0:1787574275.357041:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf847 00000100:00080000:0.0:1787574275.357047:0:6682:0:(import.c:65:import_set_state_nolock()) ffff982a07895800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787574275.357068:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787574275.357297:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+2:2349:x1874407272232960:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 269us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574275.357306:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:0.0:1787574275.357341:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272232448 00000100:00100000:0.0:1787574275.357346:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272232448 00000100:00100000:0.0:1787574275.357374:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 225 00000100:00100000:0.0:1787574275.357381:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04967850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:2352:x1874407272232448:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574275.357425:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04967850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:2352:x1874407272232448:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 45us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574275.357431:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 225 00000100:00100000:0.0:1787574275.357464:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272232704 00000100:00100000:0.0:1787574275.357468:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272232704 00000100:00100000:0.0:1787574275.357499:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272232576 00000100:00100000:0.0:1787574275.357502:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272232576 00000100:00100000:0.0:1787574275.357526:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:0.0:1787574275.357533:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2352:x1874407272232704:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574275.357566:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2352:x1874407272232704:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 34us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574275.357574:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:0.0:1787574275.357595:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:0.0:1787574275.357602:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2352:x1874407272232576:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574275.357628:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2352:x1874407272232576:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 26us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574275.357634:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00080000:0.0:1787574275.357656:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787574275.357662:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574275.357664:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787574275.357682:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574275.357800:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574275.705375:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574275.705413:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290091648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574275.705584:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574275.705665:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290091648 00000100:00100000:2.0:1787574275.705674:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290091648 00000100:00100000:2.0:1787574275.705734:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787574275.705746:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290091648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574275.705790:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787574275.705841:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290091648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574275.705849:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787574275.705894:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a069fdf80 x1874407290091648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574275.705914:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290091648:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787574275.830878:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574276.855910:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787574276.863153:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f782322b-3b13-413b-a1b9-4500fa873ef8 00000020:00000080:0.0:1787574276.863188:0:6706:0:(genops.c:885:class_export_put()) final put ffff982a07894000/f782322b-3b13-413b-a1b9-4500fa873ef8 00000020:00000080:2.0:1787574276.863355:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982a07894000/f782322b-3b13-413b-a1b9-4500fa873ef8 for lustre-OST0000 00000020:00000080:2.0:1787574276.863463:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982a07892000 for lustre-OST0000 00010000:00010000:2.0:1787574277.874364:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574278.898630:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574279.282009:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290091776:0@lo:400:kworker.0 00000100:00100000:0.0:1787574279.282120:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.282234:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290091776 00000100:00100000:0.0:1787574279.282244:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290091776 00000100:00100000:0.0:1787574279.282299:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787574279.282374:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290091776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574279.282515:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290091776:12345-0@lo:400:kworker.0 Request processed in 206us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.282524:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787574279.282585:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290091776:0@lo:400:kworker.0 00000100:00100000:0.0:1787574279.282629:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290091904:0@lo:400:kworker.0 00000100:00100000:0.0:1787574279.282680:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.282711:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290091904 00000100:00100000:0.0:1787574279.282715:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290091904 00000100:00100000:0.0:1787574279.282743:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787574279.282750:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290091904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574279.282785:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290091904:12345-0@lo:400:kworker.0 Request processed in 35us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.282791:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787574279.282818:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290091904:0@lo:400:kworker.0 00000100:00100000:1.0:1787574279.285085:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290092032:0@lo:400:kworker.0 00000100:00100000:1.0:1787574279.285161:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574279.294948:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574279.294975:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11be1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290092160:0@lo:400:kworker.0 00000100:00100000:1.0:1787574279.295133:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574279.295229:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290092032 00000100:00100000:1.0:1787574279.295241:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290092032 00000100:00100000:1.0:1787574279.295425:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787574279.295437:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290092032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574279.295500:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290092032:12345-0@lo:400:kworker.0 Request processed in 66us (10339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574279.295508:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787574279.295534:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290092160 00000100:00100000:1.0:1787574279.295538:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290092160 00000100:00100000:1.0:1787574279.295567:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787574279.295573:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290092160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574279.295601:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290092160:12345-0@lo:400:kworker.0 Request processed in 29us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574279.295608:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1787574279.295621:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787574279.295626:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787574279.295661:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a11be1c00 x1874407290092160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574279.295725:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11be1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290092160:0@lo:400:kworker.0 00000100:00100000:1.0:1787574279.295742:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290092032:0@lo:400:kworker.0 00000100:00100000:0.0:1787574279.296087:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290092288:0@lo:400:kworker.0 00000100:00100000:0.0:1787574279.296131:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.296199:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290092288 00000100:00100000:0.0:1787574279.296204:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290092288 00000100:00100000:0.0:1787574279.296244:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787574279.296252:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290092288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574279.296291:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290092288:12345-0@lo:400:kworker.0 Request processed in 40us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.296298:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787574279.296335:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290092288:0@lo:400:kworker.0 00000100:00100000:0.0:1787574279.296368:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290092416:0@lo:400:kworker.0 00000100:00100000:0.0:1787574279.296410:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.296442:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290092416 00000100:00100000:0.0:1787574279.296446:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290092416 00000100:00100000:0.0:1787574279.296472:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787574279.296479:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290092416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574279.296538:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290092416:12345-0@lo:400:kworker.0 Request processed in 59us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.296544:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1787574279.296574:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a11be2300 x1874407290092416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574279.296584:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290092416:0@lo:400:kworker.0 00000100:00080000:1.0:1787574279.296729:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787574279.296733:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1787574279.334724:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f782322b-3b13-413b-a1b9-4500fa873ef8 00000020:00000080:1.0:1787574279.334737:0:7648:0:(genops.c:885:class_export_put()) final put ffff982a07892800/f782322b-3b13-413b-a1b9-4500fa873ef8 00000020:00000080:0.0:1787574279.334823:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff982a07892800/f782322b-3b13-413b-a1b9-4500fa873ef8 for lustre-OST0001 00000020:00000080:0.0:1787574279.334883:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982a07895800 for lustre-OST0001 00000100:00100000:1.0:1787574279.797537:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574279.797569:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290092544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574279.797676:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574279.797768:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290092544 00000100:00100000:1.0:1787574279.797778:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290092544 00000100:00100000:1.0:1787574279.797841:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787574279.797852:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290092544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574279.797898:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787574279.797962:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290092544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574279.797970:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1787574279.798072:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a0355d880 x1874407290092544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574279.798093:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290092544:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787574279.922500:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574280.482972:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574280.483530:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574280.483562:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574280.483597:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272233088 00000100:00100000:1.0:1787574280.483611:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272233088 00000100:00100000:1.0:1787574280.483676:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 227 00000100:00100000:1.0:1787574280.483687:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+13:2353:x1874407272233088:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574280.484145:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+13:2353:x1874407272233088:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 458us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574280.484154:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 227 00000100:00100000:1.0:1787574280.484214:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272233344 00000100:00100000:1.0:1787574280.484219:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272233344 00000100:00100000:1.0:1787574280.484259:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272233216 00000100:00100000:1.0:1787574280.484263:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272233216 00000100:00100000:1.0:1787574280.484289:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:1.0:1787574280.484315:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2353:x1874407272233344:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574280.484350:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2353:x1874407272233344:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 54us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574280.484497:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:1.0:1787574280.484514:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:1.0:1787574280.484522:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2353:x1874407272233216:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574280.484551:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2353:x1874407272233216:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 30us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574280.484558:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00080000:1.0:1787574280.485134:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574280.817551:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290092672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574280.817649:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574280.821257:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290092672 00000100:00100000:2.0:1787574280.821277:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290092672 00000100:00100000:2.0:1787574280.821425:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787574280.821439:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290092672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574280.821566:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787574280.821687:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290092672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 251us (4038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574280.821696:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1787574280.821793:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a069fdf80 x1874407290092672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574280.821819:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290092672:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787574280.947561:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574281.970925:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787574282.430463:0:11025:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787574282.993999:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574284.017412:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574284.404718:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290092928:0@lo:400:kworker.0 00000100:00100000:2.0:1787574284.404809:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574284.404871:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290093440:0@lo:400:kworker.0 00000100:00100000:2.0:1787574284.404898:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574284.404931:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787574284.404937:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290092800:0@lo:400:kworker.0 00000100:00100000:2.0:1787574284.404965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574284.404987:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874407290093312:0@lo:400:kworker.0 00000100:00100000:2.0:1787574284.405006:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574284.407398:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290093056:0@lo:400:kworker.0 00000100:00100000:2.0:1787574284.407991:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574284.409795:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574284.409822:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a069fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290093184:0@lo:400:kworker.0 00000100:00100000:2.0:1787574284.409888:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574284.409932:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290092928 00000100:00100000:2.0:1787574284.409940:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290092928 00000100:00100000:2.0:1787574284.409984:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290093312 00000100:00100000:2.0:1787574284.409988:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290093312 00000100:00100000:2.0:1787574284.410013:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290093056 00000100:00100000:2.0:1787574284.410017:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290093056 00000100:00100000:2.0:1787574284.410035:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787574284.410043:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290092928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574284.410096:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290092928:12345-0@lo:400:kworker.0 Request processed in 53us (5287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574284.410103:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787574284.410119:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787574284.410125:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874407290093312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574284.410153:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874407290093312:12345-0@lo:400:kworker.0 Request processed in 29us (5146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574284.410159:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787574284.410190:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787574284.410197:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290093056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574284.410761:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290093440 00000100:00100000:1.0:1787574284.410768:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290093440 00000100:00100000:1.0:1787574284.410798:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290093184 00000100:00100000:1.0:1787574284.410801:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290093184 00000100:00100000:1.0:1787574284.410821:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787574284.410827:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290093440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574284.410870:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290093440:12345-0@lo:400:kworker.0 Request processed in 43us (5971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574284.410876:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787574284.410889:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787574284.410895:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290093184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574284.410928:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290093184:12345-0@lo:400:kworker.0 Request processed in 34us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574284.410934:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787574284.412419:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290093056:12345-0@lo:400:kworker.0 Request processed in 2217us (4424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574284.412431:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787574284.413127:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290092800 00000100:00100000:2.0:1787574284.413136:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290092800 00000100:00100000:2.0:1787574284.413734:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787574284.413747:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:3299:x1874407290092800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574284.413814:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:3299:x1874407290092800:12345-0@lo:400:kworker.0 Request processed in 71us (8848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574284.413820:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:2.0:1787574284.413858:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574284.413863:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787574284.413866:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787574284.413896:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a069fca80 x1874407290093184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574284.413912:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290093184:0@lo:400:kworker.0 00000100:00100000:2.0:1787574284.413925:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290093056:0@lo:400:kworker.0 00000100:00100000:2.0:1787574284.413959:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290092800:0@lo:400:kworker.0 00000100:00100000:2.0:1787574284.413971:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874407290093312:0@lo:400:kworker.0 00000100:00100000:2.0:1787574284.413982:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290092928:0@lo:400:kworker.0 00010000:00080000:2.0:1787574284.413993:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a069fd500 x1874407290093440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574284.414002:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a069fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290093440:0@lo:400:kworker.0 00000100:00100000:3.0:1787574284.917182:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574284.917215:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290093568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574284.917304:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574284.918208:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290093568 00000100:00100000:1.0:1787574284.918218:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290093568 00000100:00100000:1.0:1787574284.918285:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787574284.918295:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290093568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574284.918333:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787574284.918407:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290093568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574284.918415:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787574284.918457:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a0355d880 x1874407290093568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574284.918479:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290093568:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787574285.061770:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574285.598670:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574285.598723:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574285.598761:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574285.598844:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272233600 00000100:00100000:2.0:1787574285.598857:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272233600 00000100:00100000:2.0:1787574285.598932:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272233728 00000100:00100000:2.0:1787574285.598936:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272233728 00000100:00100000:2.0:1787574285.598965:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:2.0:1787574285.598978:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2351:x1874407272233600:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574285.599077:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2351:x1874407272233600:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 100us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574285.599102:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:2.0:1787574285.599128:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:2.0:1787574285.599138:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2351:x1874407272233728:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574285.599209:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2351:x1874407272233728:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 72us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574285.599218:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00080000:0.0:1787574285.599523:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574285.599624:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272233472 00000100:00100000:3.0:1787574285.599631:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272233472 00000100:00100000:3.0:1787574285.599665:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 229 00000100:00100000:3.0:1787574285.599674:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+13:2351:x1874407272233472:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574285.599720:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+13:2351:x1874407272233472:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 47us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574285.599727:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 229 00000100:00100000:2.0:1787574285.939144:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574285.939185:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290093696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574285.939257:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574285.939377:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290093696 00000100:00100000:1.0:1787574285.939385:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290093696 00000100:00100000:1.0:1787574285.939434:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787574285.939444:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290093696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574285.939479:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787574285.939531:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290093696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574285.939538:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1787574285.943275:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a3a684700 x1874407290093696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574285.943301:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290093696:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787574286.066494:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787574286.417312:0:11174:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea6b09980 20000000:00000080:3.0:1787574286.417328:0:11174:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff982a41c7b400 uarg=0000000000000000 20000000:01000000:3.0:1787574286.417370:0:11174:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787574286.417376:0:11174:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787574286.417380:0:11174:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787574286.419715:0:11175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787574286.419928:0:11174:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787574286.436252:0:11174:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787574286.436914:0:11174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf84e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574286.436935:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea66 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574286.436945:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a1d2abc00/0xfe91058e646bf801 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf7fa expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574286.436956:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a027f2c00/0xfe91058e646bf80f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf808 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574286.437052:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a027f2000/0xfe91058e646bf81d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf816 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574286.437060:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a1d2aaa00/0xfe91058e646bf832 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea9e expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574286.437068:0:11174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf84e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574286.437113:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a1d2aaa00/0xfe91058e646bf832 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea9e expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574286.437130:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982a1d2aaa00/0xfe91058e646bf832 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea9e expref: 12 pid: 5823 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574286.437146:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a684700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874407290093824:192.168.206.51@tcp:104: 00010000:00010000:2.0:1787574286.437577:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a027f2000/0xfe91058e646bf81d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf816 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574286.437586:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a027f2000/0xfe91058e646bf81d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf816 expref: 18 pid: 5824 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574286.437594:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a684000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874407290093952:0@lo:104: 00000100:00100000:2.0:1787574286.437634:0:11174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574286.437812:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a027f2c00/0xfe91058e646bf80f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf808 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574286.437821:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a027f2c00/0xfe91058e646bf80f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf808 expref: 18 pid: 5825 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574286.437837:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a686a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874407290094080:0@lo:104: 00000100:00100000:2.0:1787574286.437863:0:11174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574286.437895:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a1d2abc00/0xfe91058e646bf801 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf7fa expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574286.437903:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a1d2abc00/0xfe91058e646bf801 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf7fa expref: 18 pid: 5825 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574286.437910:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a687480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874407290094208:0@lo:104: 00000100:00100000:2.0:1787574286.437929:0:11174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574286.437945:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea66 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574286.437953:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea66 expref: 12 pid: 5824 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574286.437960:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a686680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874407290094336:192.168.206.51@tcp:104: 00000100:00100000:2.0:1787574286.438060:0:11174:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a069f80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574286.438107:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290093952 00000100:00100000:0.0:1787574286.438111:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290094080 00000100:00100000:2.0:1787574286.438115:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290093952 00000100:00100000:0.0:1787574286.438115:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290094080 00000100:00100000:2.0:1787574286.438149:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290094208 00000100:00100000:2.0:1787574286.438152:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290094208 00000100:00100000:0.0:1787574286.438155:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787574286.438187:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a684a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+5:11174:x1874407290094080:12345-0@lo:104: 00010000:00010000:0.0:1787574286.438198:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab800/0xfe91058e646bf808 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf80f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574286.438257:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787574286.438270:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a684a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+5:11174:x1874407290094080:12345-0@lo:104: Request processed in 107us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574286.438276:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787574286.438294:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787574286.438301:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a684380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+4:11174:x1874407290093952:12345-0@lo:104: 00010000:00010000:0.0:1787574286.438308:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf816 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf81d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574286.438341:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787574286.438356:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a684380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+4:11174:x1874407290093952:12345-0@lo:104: Request processed in 56us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574286.438362:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787574286.438375:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787574286.438381:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a687b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+3:11174:x1874407290094208:12345-0@lo:104: 00010000:00010000:0.0:1787574286.438388:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a42044a00/0xfe91058e646bf7fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf801 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574286.438413:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787574286.438418:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a687b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+3:11174:x1874407290094208:12345-0@lo:104: Request processed in 38us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574286.438424:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787574286.438516:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787574286.438522:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab800/0xfe91058e646bf808 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf80f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574286.438530:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2ab800 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:0.0:1787574286.438534:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab800/0xfe91058e646bf808 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf80f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574286.438552:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab800/0xfe91058e646bf808 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf80f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574286.438559:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab800/0xfe91058e646bf808 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf80f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574286.438565:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787574286.438594:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab800/0xfe91058e646bf808 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf80f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574286.438600:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574286.438619:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab800/0xfe91058e646bf808 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf80f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574286.438623:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a684000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874407290093952:0@lo:104: 00010000:00010000:0.0:1787574286.438627:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab800/0xfe91058e646bf808 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf80f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574286.438633:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a686a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874407290094080:0@lo:104: 00000100:00100000:2.0:1787574286.438639:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a687480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874407290094208:0@lo:104: 00010000:00010000:0.0:1787574286.438641:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574286.438645:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf816 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf81d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574286.438650:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030e00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:0.0:1787574286.438653:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf816 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf81d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574286.438660:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf816 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf81d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574286.438666:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf816 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf81d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574286.438677:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787574286.438694:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf816 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf81d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574286.438700:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574286.438707:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf816 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf81d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574286.438713:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a00030e00/0xfe91058e646bf816 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf81d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574286.438722:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574286.438724:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a42044a00/0xfe91058e646bf7fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf801 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574286.438729:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a42044a00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:0.0:1787574286.438732:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a42044a00/0xfe91058e646bf7fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf801 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574286.438738:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a42044a00/0xfe91058e646bf7fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf801 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574286.438744:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a42044a00/0xfe91058e646bf7fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf801 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574286.438750:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787574286.438762:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a42044a00/0xfe91058e646bf7fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf801 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574286.438767:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787574286.439063:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a2ff01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290094720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574286.439099:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574286.439146:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290094720 00000100:00100000:2.0:1787574286.439150:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290094720 00010000:00010000:2.0:1787574286.439184:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a1d2abc00/0xfe91058e646bf801 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf7fa expref: 19 pid: 5825 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574286.439206:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787574286.439214:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+19:3300:x1874407290094720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574286.439224:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574286.439230:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a1d2abc00/0xfe91058e646bf801 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf7fa expref: 19 pid: 5825 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574286.439240:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a1d2abc00/0xfe91058e646bf801 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf7fa expref: 19 pid: 5825 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574286.439253:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a1d2abc00/0xfe91058e646bf801 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf7fa expref: 19 pid: 5825 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574286.439264:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574286.439958:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+18:3300:x1874407290094720:12345-0@lo:103:ldlm_bl.0 Request processed in 742us (854us total) trans 0 rc 0/0 00010000:00010000:0.0:1787574286.439994:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a42044a00/0xfe91058e646bf7fa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf801 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574286.440003:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a42044a00/0xfe91058e646bf7fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf801 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574286.440257:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574286.440260:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574286.440262:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574286.440268:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574286.440288:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290094464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574286.440320:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574286.440357:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574286.440363:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a2ff03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290094592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574286.440384:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574286.440414:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290094464 00000100:00100000:0.0:1787574286.440419:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290094464 00000100:00100000:1.0:1787574286.440534:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290094592 00000100:00100000:1.0:1787574286.440539:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290094592 00010000:00010000:1.0:1787574286.440557:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a027f2000/0xfe91058e646bf81d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf816 expref: 20 pid: 5824 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574286.440588:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a027f2c00/0xfe91058e646bf80f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf808 expref: 20 pid: 5825 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574286.440914:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787574286.441144:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a2ff01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290094720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574286.441624:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787574286.443455:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290094592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787574286.443480:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574286.443490:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a027f2000/0xfe91058e646bf81d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf816 expref: 19 pid: 5824 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574286.443517:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a027f2000/0xfe91058e646bf81d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf816 expref: 19 pid: 5824 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574286.443535:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a027f2000/0xfe91058e646bf81d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf816 expref: 19 pid: 5824 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574286.443552:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574286.443612:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7182851c-b624-4982-87cf-e891100b1765+18:3298:x1874407290094592:12345-0@lo:103:ldlm_bl.0 Request processed in 1978us (3225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574286.443620:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787574286.443658:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787574286.443668:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7182851c-b624-4982-87cf-e891100b1765+17:3298:x1874407290094464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787574286.443677:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574286.443683:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a027f2c00/0xfe91058e646bf80f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf808 expref: 17 pid: 5825 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574286.445548:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a027f2c00/0xfe91058e646bf80f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf808 expref: 17 pid: 5825 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574286.445571:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a027f2c00/0xfe91058e646bf80f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf808 expref: 17 pid: 5825 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574286.445588:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574286.445597:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a2ff03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290094592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574286.445676:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7182851c-b624-4982-87cf-e891100b1765+16:3298:x1874407290094464:12345-0@lo:103:ldlm_bl.0 Request processed in 2010us (5355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574286.445685:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787574286.445755:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290094464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574286.445855:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a684700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874407290093824:192.168.206.51@tcp:104: 00000100:00100000:2.0:1787574286.445866:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a686680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874407290094336:192.168.206.51@tcp:104: 00010000:00010000:2.0:1787574286.445895:0:11174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf84e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574286.446199:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574286.446229:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574286.446255:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272233984 00000100:00100000:3.0:1787574286.446260:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272233984 00010000:00010000:3.0:1787574286.446290:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea66 expref: 13 pid: 5824 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574286.446308:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272233856 00000100:00100000:3.0:1787574286.446311:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272233856 00010000:00010000:3.0:1787574286.446322:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a1d2aaa00/0xfe91058e646bf832 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea9e expref: 14 pid: 5823 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574286.446336:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:3.0:1787574286.446354:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9891405-66e8-4ae2-851e-6434ae47d085+14:2350:x1874407272233984:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574286.446367:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574286.446373:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea66 expref: 14 pid: 5824 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574286.446381:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea66 expref: 14 pid: 5824 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574286.446413:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a42045e00/0xfe91058e646bf7f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea66 expref: 14 pid: 5824 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574286.446425:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574286.446482:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9891405-66e8-4ae2-851e-6434ae47d085+13:2350:x1874407272233984:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 138us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574286.446488:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:3.0:1787574286.446504:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:3.0:1787574286.446511:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9891405-66e8-4ae2-851e-6434ae47d085+12:2350:x1874407272233856:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574286.446519:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574286.446524:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a1d2aaa00/0xfe91058e646bf832 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea9e expref: 12 pid: 5823 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574286.446532:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a1d2aaa00/0xfe91058e646bf832 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea9e expref: 12 pid: 5823 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574286.446543:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a1d2aaa00/0xfe91058e646bf832 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea9e expref: 12 pid: 5823 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574286.446555:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf84e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574286.446563:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf84e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574286.446577:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf84e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574286.446595:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf84e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574286.446602:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf84e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574286.446609:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf84e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574286.446616:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2aa600 already unused, calling callback (ffffffffc142f230) 00010000:00010000:3.0:1787574286.446620:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf84e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574286.446628:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf84e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574286.446640:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf84e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574286.446649:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574286.446670:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9891405-66e8-4ae2-851e-6434ae47d085+11:2350:x1874407272233856:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 160us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574286.446677:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00010000:00010000:2.0:1787574286.446868:0:11174:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf84e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574286.446887:0:11174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf84e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574286.446893:0:11174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf84e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574287.089544:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574287.900395:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574287.900432:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272234112 00000100:00100000:3.0:1787574287.900440:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272234112 00000100:00100000:3.0:1787574287.900486:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 230 00000100:00100000:3.0:1787574287.900495:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+11:5591:x1874407272234112:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574287.900509:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574287.900533:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a16143600/0xfe91058e646bf855 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eac8 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574287.900558:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a16143600/0xfe91058e646bf855 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eac8 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574287.900569:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a16143600/0xfe91058e646bf855 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eac8 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574287.900578:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16143600, rc 0) 00000100:00100000:3.0:1787574287.900624:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+12:5591:x1874407272234112:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 130us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574287.900631:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 230 00000100:00100000:1.0:1787574287.902662:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574287.902698:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272234240 00000100:00100000:1.0:1787574287.902714:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272234240 00000100:00100000:1.0:1787574287.902760:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 231 00000100:00100000:1.0:1787574287.902769:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+12:5591:x1874407272234240:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574287.903055:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+12:5591:x1874407272234240:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 286us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574287.903063:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 231 00000100:00100000:0.0:1787574287.917273:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574287.918414:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272234368 00000100:00100000:1.0:1787574287.918425:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272234368 00000100:00100000:0.0:1787574287.918544:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 232 00000100:00100000:0.0:1787574287.918555:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+12:5591:x1874407272234368:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574287.918856:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+12:5591:x1874407272234368:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 301us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574287.918865:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 232 00000100:00100000:3.0:1787574287.932825:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574287.932863:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272234496 00000100:00100000:3.0:1787574287.932873:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272234496 00000100:00100000:3.0:1787574287.932922:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 233 00000100:00100000:3.0:1787574287.932933:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+12:5591:x1874407272234496:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574287.932951:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574287.932970:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a16142600/0xfe91058e646bf85c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eacf expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574287.932998:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a16142600/0xfe91058e646bf85c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eacf expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574287.933009:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a16142600/0xfe91058e646bf85c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eacf expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574287.933019:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142600, rc 0) 00000100:00100000:3.0:1787574287.937489:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+13:5591:x1874407272234496:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 4548us (4663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574287.937501:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 233 00000100:00100000:0.0:1787574287.942714:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574287.944848:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272234624 00000100:00100000:1.0:1787574287.944862:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272234624 00000100:00100000:1.0:1787574287.944930:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 234 00000100:00100000:1.0:1787574287.944941:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+13:5591:x1874407272234624:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574287.945282:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+13:5591:x1874407272234624:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 341us (2573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574287.945291:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 234 00000100:00100000:1.0:1787574287.955921:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574287.956054:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272234752 00000100:00100000:3.0:1787574287.956063:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272234752 00000100:00100000:3.0:1787574287.956116:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 235 00000100:00100000:3.0:1787574287.956126:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+13:5591:x1874407272234752:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574287.956382:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+13:5591:x1874407272234752:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 255us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574287.956391:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 235 10000000:01000000:0.0:1787574288.116261:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787574288.116270:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982a3a5c3000 from 7 10000000:01000000:0.0:1787574288.116274:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787574288.116323:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf863 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574288.116346:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf863 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574288.116358:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf863 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574288.116385:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290094848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787574288.116457:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574288.116506:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982907d413c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574288.116528:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290094848 00000100:00100000:0.0:1787574288.116535:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290094848 00000100:00100000:0.0:1787574288.116581:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787574288.116589:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+16:5827:x1874407290094848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574288.116601:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574288.116613:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a00031200/0xfe91058e646bf86a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf863 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574288.116634:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a00031200/0xfe91058e646bf86a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf863 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574288.116644:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a00031200/0xfe91058e646bf86a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf863 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574288.116654:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a00031200, rc 0) 00000100:00100000:0.0:1787574288.116708:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290094848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574288.116715:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787574288.116758:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290094848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574288.116772:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf863 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf86a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574288.116781:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf863 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf86a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574288.116845:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290094976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574288.116868:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574288.127235:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574288.127555:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982907d413c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574288.127597:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290094976 00000100:00100000:0.0:1787574288.127606:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290094976 00000100:00100000:0.0:1787574288.127675:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787574288.127686:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290094976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574288.128747:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290094976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1058us (11873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574288.128759:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787574288.130779:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290094976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574288.130854:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a686680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290095104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574288.130923:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574288.130980:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a41251780 going to sleep for 11 seconds 00000100:00100000:1.0:1787574288.134188:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290095104 00000100:00100000:1.0:1787574288.134203:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290095104 00000100:00100000:1.0:1787574288.134261:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787574288.134271:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290095104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574288.134524:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290095104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 254us (3600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574288.134533:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787574288.137048:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a686680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290095104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787574288.138450:0:11211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787574288.138623:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787574288.138660:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787574288.138671:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf863 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf86a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574288.138683:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf863 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf86a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574288.138693:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787574288.138696:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982a41658000 from 7 10000000:01000000:2.0:1787574288.138699:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787574288.138736:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2abc00/0xfe91058e646bf871 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574288.138744:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a1d2abc00/0xfe91058e646bf871 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574288.138772:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a1d2abc00/0xfe91058e646bf871 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574288.138797:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a684700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290095232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787574288.138880:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574288.138921:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a41251000 going to sleep for 11 seconds 00000100:00100000:1.0:1787574288.139192:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290095232 00000100:00100000:1.0:1787574288.139200:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290095232 00000100:00100000:1.0:1787574288.139246:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787574288.139255:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290095232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574288.139273:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574288.139286:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a42045e00/0xfe91058e646bf878 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf871 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574288.139309:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a42045e00/0xfe91058e646bf878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf871 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574288.139319:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a42045e00/0xfe91058e646bf878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf871 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574288.139327:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a42045e00, rc 0) 00000100:00100000:1.0:1787574288.139380:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290095232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574288.139387:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787574288.139567:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a684700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290095232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574288.139582:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a1d2abc00/0xfe91058e646bf871 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf878 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574288.139590:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a1d2abc00/0xfe91058e646bf871 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf878 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574288.139640:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290095360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574288.139669:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574288.139699:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a41df6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787574288.139741:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290095360 00000100:00100000:2.0:1787574288.139745:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290095360 00000100:00100000:2.0:1787574288.139773:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787574288.139781:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290095360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574288.140299:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290095360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 517us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574288.140307:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787574288.140689:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290095360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574288.140727:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290095488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574288.140768:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574288.140824:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a41df6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787574288.141213:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290095488 00000100:00100000:1.0:1787574288.141218:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290095488 00000100:00100000:1.0:1787574288.141251:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787574288.141258:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290095488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574288.141445:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290095488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574288.141451:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787574288.141497:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290095488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787574288.142515:0:11212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787574288.145318:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787574288.145359:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787574288.145371:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2abc00/0xfe91058e646bf871 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf878 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574288.145383:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a1d2abc00/0xfe91058e646bf871 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf878 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574288.145411:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787574288.145414:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982a0622a800 from 7 10000000:01000000:0.0:1787574288.145417:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787574288.145455:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf87f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574288.145463:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf87f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574288.145474:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf87f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574288.145498:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290095616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787574288.145567:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574288.145620:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982907d413c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574288.145734:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290095616 00000100:00100000:2.0:1787574288.145741:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290095616 00000100:00100000:2.0:1787574288.145796:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787574288.145805:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290095616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574288.145828:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574288.145840:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf886 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf87f expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574288.145864:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf886 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf87f expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574288.145874:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf886 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf87f expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574288.145892:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a1d2aa600, rc 0) 00000100:00100000:2.0:1787574288.145937:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290095616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574288.145943:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787574288.147245:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290095616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574288.147268:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf87f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574288.147279:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf87f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574288.147359:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290095744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574288.147407:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574288.147443:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982907d413c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574288.147520:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290095744 00000100:00100000:3.0:1787574288.147526:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290095744 00000100:00100000:3.0:1787574288.147575:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787574288.147584:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a10091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290095744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574288.147877:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a10091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290095744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574288.147886:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787574288.147924:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290095744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574288.147972:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290095872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574288.148098:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574288.148115:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a41df6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574288.148130:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290095872 00000100:00100000:3.0:1787574288.148133:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290095872 00000100:00100000:3.0:1787574288.148155:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787574288.148161:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a10093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290095872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574288.148326:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a10093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290095872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574288.148344:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787574288.148383:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290095872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787574288.152823:0:11213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787574288.155488:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787574288.155520:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787574288.155533:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf87f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574288.155546:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf87f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574289.137380:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574289.529442:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290096000:0@lo:400:kworker.0 00000100:00100000:1.0:1787574289.529519:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574289.529569:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874407290096512:0@lo:400:kworker.0 00000100:00100000:1.0:1787574289.529608:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574289.529636:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574289.529642:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290096384:0@lo:400:kworker.0 00000100:00100000:1.0:1787574289.529669:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574289.529698:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0355c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290096128:0@lo:400:kworker.0 00000100:00100000:1.0:1787574289.529725:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574289.529743:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290096640:0@lo:400:kworker.0 00000100:00100000:1.0:1787574289.529764:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574289.529782:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574289.529788:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290096256:0@lo:400:kworker.0 00000100:00100000:1.0:1787574289.529809:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574289.529837:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290096000 00000100:00100000:1.0:1787574289.529845:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290096000 00000100:00100000:1.0:1787574289.529888:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787574289.529897:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a10093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:3301:x1874407290096000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574289.529959:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a10093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:3301:x1874407290096000:12345-0@lo:400:kworker.0 Request processed in 63us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574289.529966:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787574289.529996:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290096512 00000100:00100000:1.0:1787574289.530000:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290096512 00000100:00100000:1.0:1787574289.530029:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290096128 00000100:00100000:1.0:1787574289.530032:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290096128 00000100:00100000:1.0:1787574289.530044:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290096256 00000100:00100000:1.0:1787574289.530046:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290096256 00000100:00100000:1.0:1787574289.530061:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787574289.530068:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874407290096512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574289.530097:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874407290096512:12345-0@lo:400:kworker.0 Request processed in 30us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574289.530111:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787574289.530125:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787574289.530131:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290096128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574289.530197:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290096128:12345-0@lo:400:kworker.0 Request processed in 35us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574289.530204:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787574289.530216:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787574289.530222:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290096256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574289.530249:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290096256:12345-0@lo:400:kworker.0 Request processed in 28us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574289.530254:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787574289.530271:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290096384 00000100:00100000:1.0:1787574289.530275:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290096384 00000100:00100000:1.0:1787574289.530297:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290096640 00000100:00100000:1.0:1787574289.530300:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290096640 00000100:00100000:1.0:1787574289.530319:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787574289.530337:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290096384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574289.530368:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290096384:12345-0@lo:400:kworker.0 Request processed in 43us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574289.530375:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787574289.530386:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787574289.530392:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290096640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574289.530419:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290096640:12345-0@lo:400:kworker.0 Request processed in 28us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574289.530424:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787574289.530484:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290096256:0@lo:400:kworker.0 00000100:00100000:1.0:1787574289.530494:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290096128:0@lo:400:kworker.0 00010000:00080000:1.0:1787574289.530505:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41d3f100 x1874407290096640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574289.530515:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290096640:0@lo:400:kworker.0 00010000:00080000:1.0:1787574289.530543:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41d3df80 x1874407290096384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574289.530552:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290096384:0@lo:400:kworker.0 00000100:00100000:1.0:1787574289.530561:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0355d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290096000:0@lo:400:kworker.0 00000100:00100000:1.0:1787574289.530570:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874407290096512:0@lo:400:kworker.0 00000100:00080000:0.0:1787574289.530853:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574289.530858:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574289.530867:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574290.034379:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574290.034402:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290096768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574290.034469:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574290.034527:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290096768 00000100:00100000:1.0:1787574290.034534:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290096768 00000100:00100000:1.0:1787574290.034579:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787574290.034590:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290096768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574290.034626:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787574290.034668:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290096768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574290.034676:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1787574290.034719:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41d3f800 x1874407290096768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574290.034748:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290096768:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787574290.174920:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574290.719145:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574290.719237:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574290.719261:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574290.719311:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272235008 00000100:00100000:2.0:1787574290.719329:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272235008 00000100:00100000:2.0:1787574290.719389:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272235136 00000100:00100000:2.0:1787574290.719393:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272235136 00000100:00100000:2.0:1787574290.719430:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:2.0:1787574290.719442:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2353:x1874407272235008:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574290.719523:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2353:x1874407272235008:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 83us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574290.719532:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:2.0:1787574290.719552:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:2.0:1787574290.719560:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2353:x1874407272235136:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574290.719587:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2353:x1874407272235136:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 29us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574290.719610:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00080000:2.0:1787574290.719630:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574290.719752:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272234880 00000100:00100000:0.0:1787574290.719758:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272234880 00000100:00100000:0.0:1787574290.719790:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 246 00000100:00100000:0.0:1787574290.719797:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+13:2353:x1874407272234880:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574290.719825:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+13:2353:x1874407272234880:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 28us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574290.719830:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 246 00000100:00100000:1.0:1787574291.057453:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290096896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574291.057542:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574291.057704:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290096896 00000100:00100000:2.0:1787574291.057716:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290096896 00000100:00080000:3.0:1787574291.057839:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574291.059228:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787574291.059251:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290096896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574291.059301:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787574291.059401:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290096896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (1858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574291.059408:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1787574291.061303:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a3a687480 x1874407290096896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574291.061346:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290096896:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787574291.066548:0:11371:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787574291.186034:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574292.211909:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574293.233594:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574294.257418:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787574294.481245:0:11471:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:24:53 (1787574293) === 00000100:00100000:2.0:1787574294.595109:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574294.595155:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574294.595268:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272235392 00000100:00100000:3.0:1787574294.595281:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272235392 00000100:00100000:3.0:1787574294.595376:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1787574294.595390:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:9685:x1874407272235392:12345-192.168.206.51@tcp:700:mkdir.0 00000100:00100000:3.0:1787574294.595484:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:9685:x1874407272235392:12345-192.168.206.51@tcp:700:mkdir.0 Request processed in 98us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574294.595493:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:1.0:1787574294.595879:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272235264 00000100:00100000:1.0:1787574294.595885:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272235264 00000100:00100000:1.0:1787574294.595917:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:1.0:1787574294.595924:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2353:x1874407272235264:12345-192.168.206.51@tcp:41:mkdir.0 00000004:00000024:1.0:1787574294.595957:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787574294.596019:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2353:x1874407272235264:12345-192.168.206.51@tcp:41:mkdir.0 Request processed in 97us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574294.596026:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00080000:2.0:1787574294.596116:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574294.600939:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574294.605867:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272235648 00000100:00100000:1.0:1787574294.605888:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272235648 00000100:00100000:1.0:1787574294.605977:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:1.0:1787574294.605989:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:9685:x1874407272235648:12345-192.168.206.51@tcp:36:mkdir.0 00010000:00010000:1.0:1787574294.606063:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574294.606833:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bf76e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea51 expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.607786:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a0de1db00) 00010000:00010000:1.0:1787574294.607804:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787574294.608585:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf88d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.609369:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf88d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.609385:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf88d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.613821:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044200/0xfe91058e646bf894 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.613846:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044200/0xfe91058e646bf894 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.613861:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044200/0xfe91058e646bf894 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574294.616121:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787574294.616144:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf88d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.616155:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf88d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.616198:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf88d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.616207:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a42045800 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574294.616213:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf88d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.616863:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf88d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.616892:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a04da2500) 00010000:00010000:0.0:1787574294.616895:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574294.616908:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf88d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.616916:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf88d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574294.616943:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008aae0f31 reply state 00000000e516b9f0 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044200/0xfe91058e646bf894 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574294.616954:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574294.617640:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:9685:x1874407272235648:12345-192.168.206.51@tcp:36:mkdir.0 Request processed in 11644us (16705us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787574294.617652:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00010000:00010000:0.0:1787574294.622034:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044200/0xfe91058e646bf894 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.622055:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044200/0xfe91058e646bf894 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.622074:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044200/0xfe91058e646bf894 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.622081:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a42044200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574294.622087:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044200/0xfe91058e646bf894 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.622095:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044200/0xfe91058e646bf894 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.622115:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff982a04da2900) 00010000:00010000:0.0:1787574294.622118:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574294.622123:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044200/0xfe91058e646bf894 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.622137:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044200/0xfe91058e646bf894 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574294.634554:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574294.634639:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272235776 00000100:00100000:1.0:1787574294.634652:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272235776 00000100:00100000:1.0:1787574294.634725:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1787574294.634738:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:9686:x1874407272235776:12345-192.168.206.51@tcp:101:chmod.0 00010000:00010000:1.0:1787574294.634774:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574294.634803:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf89b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ead6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.634885:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf8a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.634901:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.634929:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574294.635004:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787574294.635008:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787574294.635204:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.635249:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf89b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ead6 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.635270:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf8a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ead6 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.635279:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a04da2300) 00010000:00010000:1.0:1787574294.635282:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787574294.635286:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a42044a00, rc 0) 00000100:00100000:1.0:1787574294.635490:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:9686:x1874407272235776:12345-192.168.206.51@tcp:101:chmod.0 Request processed in 753us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574294.635498:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1787574294.641116:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574294.641214:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272236032 00000100:00100000:3.0:1787574294.641236:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272236032 00000100:00100000:3.0:1787574294.641313:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:3.0:1787574294.641565:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:9686:x1874407272236032:12345-192.168.206.51@tcp:36:chmod.0 00010000:00010000:3.0:1787574294.641638:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574294.641673:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf8a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ead6 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.641695:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a04da2300) 00010000:00010000:3.0:1787574294.641708:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574294.641739:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bf8a9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.641829:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bf8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.641842:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bf8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787574294.642545:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000778d3716 reply state 00000000bbc0f8a1 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bf8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574294.642557:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787574294.643137:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874407290097280:0@lo:400:kworker.0 00000100:00100000:2.0:1787574294.643257:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574294.643523:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787574294.643531:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290097152:0@lo:400:kworker.0 00000100:00100000:2.0:1787574294.643558:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574294.643579:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a2ff03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290097664:0@lo:400:kworker.0 00000100:00100000:2.0:1787574294.643608:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574294.643645:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290097280 00000100:00100000:2.0:1787574294.643652:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290097280 00000100:00100000:2.0:1787574294.643719:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290097152 00000100:00100000:2.0:1787574294.643723:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290097152 00000100:00100000:2.0:1787574294.643741:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787574294.643822:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874407290097280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574294.643880:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874407290097280:12345-0@lo:400:kworker.0 Request processed in 131us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574294.643887:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787574294.643906:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787574294.643912:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290097152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574294.643939:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290097152:12345-0@lo:400:kworker.0 Request processed in 28us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574294.643945:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1787574294.643961:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574294.643995:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290097152:0@lo:400:kworker.0 00000100:00100000:2.0:1787574294.644007:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874407290097280:0@lo:400:kworker.0 00000004:00200000:3.0:1787574294.644196:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787574294.644451:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290097024:0@lo:400:kworker.0 00000100:00100000:1.0:1787574294.644496:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574294.644537:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874407290097536:0@lo:400:kworker.0 00000100:00100000:1.0:1787574294.644561:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574294.644583:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574294.644590:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290097408:0@lo:400:kworker.0 00000100:00100000:1.0:1787574294.644638:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574294.644677:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290097664 00000100:00100000:1.0:1787574294.644682:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290097664 00000100:00100000:1.0:1787574294.644722:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290097408 00000100:00100000:1.0:1787574294.644725:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290097408 00000100:00100000:1.0:1787574294.644766:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787574294.644775:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290097664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574294.644818:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290097664:12345-0@lo:400:kworker.0 Request processed in 45us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574294.644825:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787574294.644840:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787574294.644847:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290097408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574294.644880:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290097408:12345-0@lo:400:kworker.0 Request processed in 33us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574294.644886:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1787574294.644910:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787574294.644913:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787574294.644934:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a3a684700 x1874407290097408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574294.644946:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290097408:0@lo:400:kworker.0 00000100:00100000:1.0:1787574294.644965:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290097536 00000100:00100000:1.0:1787574294.644969:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290097536 00000100:00100000:1.0:1787574294.644995:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787574294.645002:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874407290097536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574294.645036:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874407290097536:12345-0@lo:400:kworker.0 Request processed in 34us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574294.645042:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1787574294.645064:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574294.645082:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874407290097536:0@lo:400:kworker.0 00010000:00080000:1.0:1787574294.645107:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a2ff03100 x1874407290097664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574294.645116:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a2ff03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290097664:0@lo:400:kworker.0 00000100:00100000:3.0:1787574294.645518:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:9686:x1874407272236032:12345-192.168.206.51@tcp:36:chmod.0 Request processed in 3957us (4469us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787574294.645526:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:2.0:1787574294.645844:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290097024 00000100:00100000:2.0:1787574294.645849:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290097024 00000100:00100000:2.0:1787574294.645893:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787574294.645901:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:3301:x1874407290097024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574294.645949:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:3301:x1874407290097024:12345-0@lo:400:kworker.0 Request processed in 49us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574294.645955:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787574294.646112:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290097024:0@lo:400:kworker.0 00010000:00010000:3.0:1787574294.650420:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bf8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.650440:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bf8a9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.650450:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bf8a9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.650457:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574294.650462:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bf8a9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.650471:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bf8a9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.650492:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a04dc0500) 00010000:00010000:3.0:1787574294.650495:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787574294.650501:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bf8a9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.650518:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bf8a9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574294.676736:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574294.676788:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272236160 00000100:00100000:3.0:1787574294.676801:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272236160 00000100:00100000:3.0:1787574294.676868:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:3.0:1787574294.676880:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:9687:x1874407272236160:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:3.0:1787574294.676913:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574294.676944:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bf8b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eadd expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.679180:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bf8b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.679206:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bf8b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.679616:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bf8b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574294.679804:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787574294.679809:0:7646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787574294.679920:0:7646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bf8b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.680718:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bf8b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eadd expref: 9 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.680763:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bf8b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eadd expref: 8 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.680773:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a04dc0100) 00010000:00010000:3.0:1787574294.680776:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574294.680781:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16143800, rc 0) 00000100:00100000:3.0:1787574294.680867:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:9687:x1874407272236160:12345-192.168.206.51@tcp:101:chown.0 Request processed in 3987us (4141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574294.680878:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:3.0:1787574294.691463:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574294.691512:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272236288 00000100:00100000:3.0:1787574294.691524:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272236288 00000100:00100000:3.0:1787574294.691601:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:3.0:1787574294.691614:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:9687:x1874407272236288:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:3.0:1787574294.691639:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574294.691664:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bf8be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eae4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.691755:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bf8c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.691771:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bf8c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.691783:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bf8c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.691814:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bf8cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.691821:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bf8cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.691828:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bf8cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.692211:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bf8d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.692233:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bf8d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.692241:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bf8d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574294.692353:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787574294.692358:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787574294.692434:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bf8d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.692448:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bf8c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.692454:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bf8c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.692460:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bf8c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.692474:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574294.692480:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bf8c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.692488:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bf8c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.692502:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a04dc0100) 00010000:00010000:3.0:1787574294.692505:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574294.692510:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bf8c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.692529:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bf8c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.692543:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bf8cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.692548:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bf8cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.692554:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bf8cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.692558:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16143a00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574294.692560:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bf8cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.692566:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bf8cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.692584:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff982a04dc0500) 00010000:00010000:3.0:1787574294.692587:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574294.692589:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bf8cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.692595:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bf8cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.692634:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bf8be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eae4 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.692647:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bf8d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eae4 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.692654:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982a04dc0700) 00010000:00010000:3.0:1787574294.692656:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574294.692658:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142200, rc 0) 00000100:00100000:3.0:1787574294.692738:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:9687:x1874407272236288:12345-192.168.206.51@tcp:101:chown.0 Request processed in 1127us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574294.692746:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:2.0:1787574294.702734:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574294.702830:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272236544 00000100:00100000:3.0:1787574294.702844:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272236544 00000100:00100000:3.0:1787574294.702921:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:3.0:1787574294.702934:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:9687:x1874407272236544:12345-192.168.206.51@tcp:36:chown.0 00010000:00010000:3.0:1787574294.703007:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574294.703043:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bf8d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eae4 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.703089:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982a04dc0700) 00010000:00010000:3.0:1787574294.703104:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574294.703138:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2c00/0xfe91058e646bf8da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.703152:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2c00/0xfe91058e646bf8da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.703188:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2c00/0xfe91058e646bf8da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787574294.763568:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:2.0:1787574294.763603:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:0.0:1787574294.794354:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1787574294.794576:0:7646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8192c23 reply state 0000000037c8dfbd transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2c00/0xfe91058e646bf8da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574294.794609:0:7646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787574294.795278:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1787574294.795606:0:7646:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787574294.795635:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:9687:x1874407272236544:12345-192.168.206.51@tcp:36:chown.0 Request processed in 92697us (92908us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787574294.795646:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00010000:00010000:0.0:1787574294.795755:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2c00/0xfe91058e646bf8da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.795766:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2c00/0xfe91058e646bf8da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.795779:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2c00/0xfe91058e646bf8da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.795786:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a027f2c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574294.795794:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2c00/0xfe91058e646bf8da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.795802:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2c00/0xfe91058e646bf8da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.796050:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982a04dc0e00) 00010000:00010000:0.0:1787574294.796054:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787574294.796060:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2c00/0xfe91058e646bf8da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.796067:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2c00/0xfe91058e646bf8da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574294.820321:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574294.820368:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272236672 00000100:00100000:1.0:1787574294.820380:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272236672 00000100:00100000:1.0:1787574294.820449:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:1.0:1787574294.820463:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:9688:x1874407272236672:12345-192.168.206.51@tcp:101:touch.500 00010000:00010000:1.0:1787574294.820496:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574294.820530:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646bf8e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eaeb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787574294.824604:0:5830:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4005us 00010000:00010000:1.0:1787574294.833909:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646bf8e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.833937:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646bf8e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.833952:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646bf8e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.833983:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bf8ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.833991:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bf8ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.834005:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bf8ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.834484:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1800/0xfe91058e646bf8f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.834494:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1800/0xfe91058e646bf8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.834502:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1800/0xfe91058e646bf8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574294.834584:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787574294.834589:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787574294.834696:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1800/0xfe91058e646bf8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.834712:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646bf8e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.834719:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646bf8e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.834727:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646bf8e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.834733:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574294.834739:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646bf8e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.834748:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646bf8e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.834770:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a04dc0100) 00010000:00010000:1.0:1787574294.834773:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574294.834779:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646bf8e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.834786:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646bf8e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.834799:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bf8ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.834806:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bf8ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.834812:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bf8ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.834816:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574294.834819:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bf8ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.834826:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bf8ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.834834:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff982a04da2d00) 00010000:00010000:1.0:1787574294.834836:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574294.834839:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bf8ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.834845:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bf8ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.834904:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646bf8e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eaeb expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.834920:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1800/0xfe91058e646bf8f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eaeb expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.834928:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982a04da2c00) 00010000:00010000:1.0:1787574294.834930:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787574294.834932:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1800, rc 0) 00000100:00100000:1.0:1787574294.835026:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:9688:x1874407272236672:12345-192.168.206.51@tcp:101:touch.500 Request processed in 14564us (14727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574294.835036:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:2.0:1787574294.838531:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574294.838659:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272236928 00000100:00100000:3.0:1787574294.838672:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272236928 00000100:00100000:3.0:1787574294.838741:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:3.0:1787574294.838754:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:9688:x1874407272236928:12345-192.168.206.51@tcp:101:touch.500 00010000:00010000:3.0:1787574294.838829:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574294.838854:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2000/0xfe91058e646bf8fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eaf2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.839400:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f3a00/0xfe91058e646bf904 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.839415:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f3a00/0xfe91058e646bf904 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.839425:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f3a00/0xfe91058e646bf904 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.839437:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2c00/0xfe91058e646bf90b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.839447:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2c00/0xfe91058e646bf90b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.839451:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2c00/0xfe91058e646bf90b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787574294.840351:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787574294.840577:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bf912 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.840589:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bf912 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.840599:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bf912 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.840640:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f3a00/0xfe91058e646bf904 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.840648:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f3a00/0xfe91058e646bf904 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.840655:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f3a00/0xfe91058e646bf904 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.840661:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a027f3a00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574294.840666:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f3a00/0xfe91058e646bf904 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.840674:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f3a00/0xfe91058e646bf904 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.840700:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982a04da2c00) 00010000:00010000:3.0:1787574294.840703:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574294.840709:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f3a00/0xfe91058e646bf904 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.840715:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f3a00/0xfe91058e646bf904 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787574294.840731:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4aa480c reply state 00000000934fe439 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2c00/0xfe91058e646bf90b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574294.840741:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787574294.840854:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2000/0xfe91058e646bf8fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eaf2 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.840874:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bf912 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eaf2 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.840882:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff982a04dc0300) 00010000:00010000:3.0:1787574294.840885:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574294.840887:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142200, rc 0) 00000100:00100000:3.0:1787574294.841118:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+10:9688:x1874407272236928:12345-192.168.206.51@tcp:101:touch.500 Request processed in 2365us (2597us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787574294.841128:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:2.0:1787574294.846966:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:0.0:1787574294.847138:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2c00/0xfe91058e646bf90b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.847196:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2c00/0xfe91058e646bf90b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.847205:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2c00/0xfe91058e646bf90b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.847211:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a027f2c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574294.847217:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2c00/0xfe91058e646bf90b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.847225:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2c00/0xfe91058e646bf90b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.847246:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff982a04dc0700) 00010000:00010000:0.0:1787574294.847249:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574294.847254:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2c00/0xfe91058e646bf90b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.847260:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2c00/0xfe91058e646bf90b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574294.847407:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272237184 00000100:00100000:3.0:1787574294.847420:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272237184 00000100:00100000:3.0:1787574294.847493:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:3.0:1787574294.847505:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:9688:x1874407272237184:12345-192.168.206.51@tcp:36:touch.500 00010000:00010000:3.0:1787574294.847590:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574294.847615:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bf912 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eaf2 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.847629:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff982a04dc0300) 00010000:00010000:3.0:1787574294.847637:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574294.847691:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bf920 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.847706:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bf920 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.847716:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bf920 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787574294.847876:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cfc3bf68 reply state 00000000e91e4b3a transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bf920 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574294.847887:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787574294.848010:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+10:9688:x1874407272237184:12345-192.168.206.51@tcp:36:touch.500 Request processed in 506us (1059us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787574294.848017:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:1.0:1787574294.851464:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574294.851865:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272237312 00000100:00100000:2.0:1787574294.851879:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272237312 00000100:00100000:2.0:1787574294.851947:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:2.0:1787574294.851958:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+10:9688:x1874407272237312:12345-192.168.206.51@tcp:101:touch.500 00010000:00010000:2.0:1787574294.851998:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574294.852027:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab400/0xfe91058e646bf927 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eaf9 expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574294.852107:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab400/0xfe91058e646bf927 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eaf9 expref: 11 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574294.852125:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab400/0xfe91058e646bf927 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eaf9 expref: 11 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574294.852149:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff982a04dc0400) 00010000:00010000:2.0:1787574294.852152:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787574294.852158:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a1d2ab400, rc 0) 00000100:00100000:2.0:1787574294.852262:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+11:9688:x1874407272237312:12345-192.168.206.51@tcp:101:touch.500 Request processed in 305us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574294.852288:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00010000:00010000:0.0:1787574294.854252:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bf920 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.854273:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bf920 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.854282:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bf920 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.854288:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16143000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574294.854323:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bf920 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.854334:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bf920 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.854355:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff982a04dc0400) 00010000:00010000:0.0:1787574294.854358:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574294.854363:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bf920 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.854370:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bf920 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574294.855254:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574294.855376:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272237440 00000100:00100000:1.0:1787574294.855392:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272237440 00000100:00100000:1.0:1787574294.855454:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1787574294.855465:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1874407272237440:12345-192.168.206.51@tcp:8:touch.500 00010000:00080000:1.0:1787574294.855510:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:1.0:1787574294.855555:0:6683:0:(genops.c:1385:class_connect()) connect: client a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f, cookie 0xfe91058e646bf92e 00002000:00100000:1.0:1787574294.855571:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f/ffff982906b8d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787574294.855604:0:6683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787574294.855899:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787574294.855938:0:6683:0:(import.c:65:import_set_state_nolock()) ffff982906b88800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787574294.856225:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2349:x1874407272237440:12345-192.168.206.51@tcp:8:touch.500 Request processed in 759us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574294.856251:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1787574294.858734:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574294.858873:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272237568 00000100:00100000:2.0:1787574294.858886:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272237568 00000100:00100000:2.0:1787574294.858980:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:2.0:1787574294.858992:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:0:x1874407272237568:12345-192.168.206.51@tcp:2:touch.500 00000100:00080000:1.0:1787574294.861343:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1787574294.884314:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f 00000001:00080000:0.0:1787574294.884339:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1787574294.884489:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:0:x1874407272237568:12345-192.168.206.51@tcp:2:touch.500 Request processed in 25491us (25759us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787574294.884501:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:1.0:1787574294.887139:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574294.887291:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272237824 00000100:00100000:2.0:1787574294.887315:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272237824 00000100:00100000:2.0:1787574294.887449:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:2.0:1787574294.887463:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+10:9688:x1874407272237824:12345-192.168.206.51@tcp:35:touch.500 00000100:00100000:2.0:1787574294.887976:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+11:9688:x1874407272237824:12345-192.168.206.51@tcp:35:touch.500 Request processed in 504us (839us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787574294.887985:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:0.0:1787574294.898340:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574294.898453:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272237952 00000100:00100000:3.0:1787574294.898468:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272237952 00000100:00100000:3.0:1787574294.898544:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:3.0:1787574294.898557:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+11:9689:x1874407272237952:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:3.0:1787574294.898588:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574294.898613:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bf935 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb00 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.898719:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bf93c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.898735:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bf93c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.898748:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bf93c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574294.898828:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787574294.898834:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787574294.898886:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bf93c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.898920:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bf935 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb00 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.898942:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bf93c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb00 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.898951:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982a04da2c00) 00010000:00010000:3.0:1787574294.898953:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574294.898957:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16143a00, rc 0) 00000100:00100000:0.0:1787574294.899847:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+12:9689:x1874407272237952:12345-192.168.206.51@tcp:101:rm.0 Request processed in 1286us (1516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574294.899859:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:0.0:1787574294.903286:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574294.903541:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272238208 00000100:00100000:2.0:1787574294.903555:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272238208 00000100:00100000:2.0:1787574294.903692:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:2.0:1787574294.903706:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+12:9689:x1874407272238208:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:2.0:1787574294.903736:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574294.903762:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bf943 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb07 expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574294.903908:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787574294.904230:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bf943 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb07 expref: 14 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574294.904246:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a04dc0100) 00010000:00010000:2.0:1787574294.904254:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787574294.904260:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bf943 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb07 expref: 14 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574294.904274:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a1d2aaa00, rc 0) 00000100:00100000:0.0:1787574294.904452:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+13:9689:x1874407272238208:12345-192.168.206.51@tcp:101:rm.0 Request processed in 746us (1174us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1787574294.904462:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:3.0:1787574294.907592:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574294.907691:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272238336 00000100:00100000:0.0:1787574294.907703:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272238336 00000100:00100000:0.0:1787574294.907933:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:0.0:1787574294.907947:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+13:9689:x1874407272238336:12345-192.168.206.51@tcp:37:rm.0 00000100:00100000:0.0:1787574294.913814:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+13:9689:x1874407272238336:12345-192.168.206.51@tcp:37:rm.0 Request processed in 5854us (6218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574294.913832:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:2.0:1787574294.918264:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574294.918530:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272238592 00000100:00100000:0.0:1787574294.918848:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272238592 00000100:00100000:0.0:1787574294.918929:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:0.0:1787574294.918941:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a03536050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+13:9689:x1874407272238592:12345-192.168.206.51@tcp:35:rm.0 00000100:00100000:0.0:1787574294.920687:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a03536050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+14:9689:x1874407272238592:12345-192.168.206.51@tcp:35:rm.0 Request processed in 1736us (2434us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787574294.920702:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:3.0:1787574294.929954:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574294.930099:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272238848 00000100:00100000:1.0:1787574294.930113:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272238848 00000100:00100000:0.0:1787574294.930221:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:0.0:1787574294.930251:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+14:9689:x1874407272238848:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:0.0:1787574294.930289:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574294.930326:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bf951 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb0e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.930473:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bf958 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.930491:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bf958 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.930504:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bf958 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574294.930516:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787574294.930908:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bf951 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb0e expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.930931:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bf958 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb0e expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.930941:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982a04da2c00) 00010000:00010000:0.0:1787574294.930945:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787574294.930948:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a00030400, rc 0) 00000100:00100000:0.0:1787574294.931073:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+16:9689:x1874407272238848:12345-192.168.206.51@tcp:101:rm.0 Request processed in 826us (1130us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787574294.931081:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:2.0:1787574294.933523:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574294.933693:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272238976 00000100:00100000:3.0:1787574294.933705:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272238976 00000100:00100000:3.0:1787574294.933803:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:3.0:1787574294.933816:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+16:9689:x1874407272238976:12345-192.168.206.51@tcp:41:rm.0 00000004:00000024:3.0:1787574294.933900:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1787574294.934035:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+16:9689:x1874407272238976:12345-192.168.206.51@tcp:41:rm.0 Request processed in 221us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574294.934043:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:2.0:1787574294.935956:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574294.936096:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272239104 00000100:00100000:1.0:1787574294.936107:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272239104 00000100:00100000:1.0:1787574294.936257:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:1.0:1787574294.936270:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+16:9689:x1874407272239104:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:1.0:1787574294.936293:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574294.936333:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bf966 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb15 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936417:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1a00/0xfe91058e646bf96d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936434:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1a00/0xfe91058e646bf96d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936451:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1a00/0xfe91058e646bf96d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936468:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1600/0xfe91058e646bf974 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936475:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1600/0xfe91058e646bf974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936483:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1600/0xfe91058e646bf974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936626:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646bf97b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936636:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646bf97b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936643:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646bf97b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574294.936678:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787574294.936683:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787574294.936706:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646bf97b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936720:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646bf97b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936729:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1a00/0xfe91058e646bf96d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936736:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1a00/0xfe91058e646bf96d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936744:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1a00/0xfe91058e646bf96d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936751:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1a00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574294.936755:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1a00/0xfe91058e646bf96d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936764:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1a00/0xfe91058e646bf96d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936786:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982a04da2c00) 00010000:00010000:1.0:1787574294.936789:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574294.936795:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1a00/0xfe91058e646bf96d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936801:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1a00/0xfe91058e646bf96d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936815:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1600/0xfe91058e646bf974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936822:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1600/0xfe91058e646bf974 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936828:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1600/0xfe91058e646bf974 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936833:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574294.936836:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1600/0xfe91058e646bf974 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936842:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1600/0xfe91058e646bf974 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936849:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff982a04da2d00) 00010000:00010000:1.0:1787574294.936852:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574294.936855:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1600/0xfe91058e646bf974 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936861:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1600/0xfe91058e646bf974 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936909:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bf966 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb15 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936923:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646bf97b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb15 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.936931:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff982a04dc0400) 00010000:00010000:1.0:1787574294.936934:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787574294.936936:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0000, rc 0) 00000100:00100000:1.0:1787574294.937015:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+17:9689:x1874407272239104:12345-192.168.206.51@tcp:101:rm.0 Request processed in 748us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574294.937024:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:1.0:1787574294.939432:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574294.939759:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272239360 00000100:00100000:0.0:1787574294.939771:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272239360 00000100:00100000:0.0:1787574294.939838:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:0.0:1787574294.939850:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+17:9689:x1874407272239360:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:0.0:1787574294.939916:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787574294.939949:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646bf97b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb15 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.939971:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab400/0xfe91058e646bf927 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eaf9 expref: 16 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.939984:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff982a04dc0400) 00010000:00010000:0.0:1787574294.940001:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bf93c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb00 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.940032:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982a04da2c00) 00010000:00010000:0.0:1787574294.940036:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574294.940061:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bf982 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.940076:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bf982 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.940087:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bf982 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.940105:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bf989 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.940113:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bf989 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.940119:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bf989 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.940466:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf990 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.940476:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf990 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.940484:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf990 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787574294.941843:0:7646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1787574294.941860:0:7646:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 271116693421ns, next at 272116689619ns, rc = 0 00010000:00010000:0.0:1787574294.941953:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf997 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.941968:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf997 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.941980:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf997 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.941989:0:7646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf997 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.941995:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf997 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.942002:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf997 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.942028:0:7646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574294.942053:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf990 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.942060:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf990 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.942066:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574294.942066:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf990 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.942073:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a42044a00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574294.942074:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf997 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.942079:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf990 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.942080:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a42045800 already unused, calling callback (ffffffffc142f230) 00010000:00010000:3.0:1787574294.942084:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf997 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.942087:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf990 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.942089:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf997 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.942106:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff982a0de1d700) 00010000:00010000:3.0:1787574294.942109:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787574294.942113:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf997 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.942114:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff982a0de1d700) 00010000:00010000:0.0:1787574294.942117:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787574294.942120:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf997 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.942120:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf990 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.942127:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf990 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574294.942134:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574294.942135:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574294.942137:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574294.942147:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bf982 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.942153:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bf982 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.942159:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bf982 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.942258:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574294.942336:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bf982 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.942345:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bf982 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.942354:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982a04da2c00) 00010000:00010000:0.0:1787574294.942356:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574294.942360:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bf982 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.942366:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bf982 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574294.942387:0:7646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019b5460f reply state 000000000460b8e5 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bf989 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574294.942397:0:7646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574294.942504:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+16:9689:x1874407272239360:12345-192.168.206.51@tcp:36:rm.0 Request processed in 2652us (3079us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787574294.942514:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00010000:00010000:0.0:1787574294.945450:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bf989 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.945471:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bf989 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.945480:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bf989 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.945488:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030e00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574294.945494:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bf989 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.945502:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bf989 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.945522:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff982a0de1dd00) 00010000:00010000:0.0:1787574294.945525:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574294.945531:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bf989 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.945538:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bf989 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574294.946030:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574294.946221:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272239616 00000100:00100000:0.0:1787574294.946234:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272239616 00000100:00100000:0.0:1787574294.946389:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:0.0:1787574294.946401:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+15:9689:x1874407272239616:12345-192.168.206.51@tcp:35:rm.0 00000100:00100000:0.0:1787574294.947126:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+16:9689:x1874407272239616:12345-192.168.206.51@tcp:35:rm.0 Request processed in 723us (1096us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787574294.947137:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1787574294.950054:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574294.950148:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272239872 00000100:00100000:0.0:1787574294.950160:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272239872 00000100:00100000:0.0:1787574294.950338:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:0.0:1787574294.950350:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+16:9689:x1874407272239872:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:0.0:1787574294.950424:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787574294.950471:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bf958 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb0e expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.950495:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1800/0xfe91058e646bf8f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eaeb expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.950509:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982a04da2c00) 00010000:00010000:0.0:1787574294.950525:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bf8b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eadd expref: 14 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.950536:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a04dc0100) 00010000:00010000:0.0:1787574294.950543:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574294.950573:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf99e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.950604:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf99e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.950615:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf99e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.950631:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044200/0xfe91058e646bf9a5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.950639:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044200/0xfe91058e646bf9a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.950646:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044200/0xfe91058e646bf9a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.950996:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf9ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.951005:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf9ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.951012:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf9ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574294.951706:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787574294.951726:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf9ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.951735:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf9ac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.951743:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf9ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.951757:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a42045800 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574294.951762:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf9ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.951770:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf9ac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.951783:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982a0de1d500) 00010000:00010000:0.0:1787574294.951786:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787574294.951790:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf9ac lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.951796:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a42045800/0xfe91058e646bf9ac lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.951818:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf99e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.951824:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf99e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.951830:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf99e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.951835:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a42044a00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574294.951838:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf99e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.951844:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf99e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.951862:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a0de1d700) 00010000:00010000:0.0:1787574294.951865:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574294.951868:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf99e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574294.951874:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044a00/0xfe91058e646bf99e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574294.951887:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b089d714 reply state 00000000b8982ace transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044200/0xfe91058e646bf9a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574294.951897:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574294.952355:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+15:9689:x1874407272239872:12345-192.168.206.51@tcp:36:rm.0 Request processed in 2003us (2310us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787574294.952365:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00010000:00010000:1.0:1787574294.954255:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044200/0xfe91058e646bf9a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.954273:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044200/0xfe91058e646bf9a5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.954281:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044200/0xfe91058e646bf9a5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.954288:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a42044200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574294.954292:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044200/0xfe91058e646bf9a5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.954310:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044200/0xfe91058e646bf9a5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.954346:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff982a0de1da00) 00010000:00010000:1.0:1787574294.954349:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574294.954356:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044200/0xfe91058e646bf9a5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574294.954362:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a42044200/0xfe91058e646bf9a5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574295.153693:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574295.153940:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290097792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574295.154032:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574295.154322:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290097792 00000100:00100000:1.0:1787574295.154334:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290097792 00000100:00100000:1.0:1787574295.154599:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787574295.154611:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290097792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574295.154659:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787574295.154722:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290097792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574295.154730:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1787574295.154801:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a3a6cfb80 x1874407290097792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574295.154824:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290097792:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787574295.282250:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574295.838041:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574295.838090:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574295.838125:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574295.838162:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574295.838221:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272240000 00000100:00100000:2.0:1787574295.838233:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272240000 00000100:00100000:2.0:1787574295.838319:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 248 00000100:00100000:2.0:1787574295.838333:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:2350:x1874407272240000:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574295.838550:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:2350:x1874407272240000:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 220us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574295.838560:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 248 00000100:00100000:3.0:1787574295.840867:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272240128 00000100:00100000:3.0:1787574295.840887:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272240128 00000100:00100000:3.0:1787574295.840969:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272240384 00000100:00100000:3.0:1787574295.840973:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272240384 00000100:00100000:3.0:1787574295.841023:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:3.0:1787574295.841050:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+14:2350:x1874407272240128:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574295.841145:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+14:2350:x1874407272240128:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 98us (3018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574295.841153:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:3.0:1787574295.841190:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00100000:3.0:1787574295.841198:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2350:x1874407272240384:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574295.841224:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2350:x1874407272240384:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 27us (3061us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574295.841231:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00080000:3.0:1787574295.844225:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574295.844421:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272240256 00000100:00100000:1.0:1787574295.844434:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272240256 00000100:00100000:1.0:1787574295.844500:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:1.0:1787574295.844512:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2350:x1874407272240256:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574295.844613:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2350:x1874407272240256:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 102us (6521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574295.844621:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 56 00000004:00080000:2.0:1787574296.184595:0:7039:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 272359425540ns, next at 273359421544ns, rc = 0 00000100:00100000:0.0:1787574296.184604:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787574296.184629:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3ad37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290097920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574296.184702:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574296.185425:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290097920 00000100:00100000:2.0:1787574296.185438:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290097920 00000100:00100000:2.0:1787574296.185522:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787574296.185537:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290097920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574296.185565:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787574296.185638:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290097920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574296.185646:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1787574296.185894:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787574296.186706:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a3ad37b80 x1874407290097920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574296.186747:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3ad37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290097920:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787574296.306536:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574297.332117:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574298.354603:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787574298.802970:0:11620:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1787574299.383326:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574299.763581:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290098048:0@lo:400:kworker.0 00000100:00100000:3.0:1787574299.763613:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290098432:0@lo:400:kworker.0 00000100:00100000:0.0:1787574299.763961:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290098176:0@lo:400:kworker.0 00000100:00100000:3.0:1787574299.768548:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574299.768608:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290098432 00000100:00100000:3.0:1787574299.768620:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290098432 00000100:00100000:3.0:1787574299.768704:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787574299.768717:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290098432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574299.768783:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290098432:12345-0@lo:400:kworker.0 Request processed in 69us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574299.768791:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787574299.768893:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874407290098304:0@lo:400:kworker.0 00000100:00100000:1.0:1787574299.768895:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574299.768934:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574299.768962:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874407290098560:0@lo:400:kworker.0 00000100:00100000:1.0:1787574299.768998:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787574299.771217:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574299.771245:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290098304 00000100:00100000:3.0:1787574299.771284:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290098304 00000100:00100000:3.0:1787574299.771356:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290098560 00000100:00100000:3.0:1787574299.771360:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290098560 00000100:00100000:3.0:1787574299.771400:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787574299.771412:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874407290098304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574299.771533:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874407290098304:12345-0@lo:400:kworker.0 Request processed in 123us (2596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574299.771541:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787574299.771565:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787574299.771571:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874407290098560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574299.771607:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874407290098560:12345-0@lo:400:kworker.0 Request processed in 37us (2609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574299.771614:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1787574299.771634:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574299.771672:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874407290098304:0@lo:400:kworker.0 00010000:00080000:3.0:1787574299.771739:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a3a6cfb80 x1874407290098432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574299.771752:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290098432:0@lo:400:kworker.0 00000100:00100000:1.0:1787574299.772561:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290098048 00000100:00100000:1.0:1787574299.772572:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290098048 00000100:00100000:1.0:1787574299.772628:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787574299.772640:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:3301:x1874407290098048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574299.772707:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:3301:x1874407290098048:12345-0@lo:400:kworker.0 Request processed in 70us (3810us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574299.772715:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787574299.773725:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874407290098560:0@lo:400:kworker.0 00000100:00100000:1.0:1787574299.773745:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290098048:0@lo:400:kworker.0 00000100:00100000:1.0:1787574299.775431:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574299.775481:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290098176 00000100:00100000:1.0:1787574299.775491:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290098176 00000100:00100000:1.0:1787574299.775544:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787574299.775555:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290098176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574299.775612:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290098176:12345-0@lo:400:kworker.0 Request processed in 59us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574299.775619:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787574299.775666:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290098176:0@lo:400:kworker.0 00000100:00100000:1.0:1787574299.775678:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290098688:0@lo:400:kworker.0 00000100:00100000:1.0:1787574299.775722:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574299.775747:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290098688 00000100:00100000:1.0:1787574299.775752:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290098688 00000100:00100000:1.0:1787574299.775795:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787574299.775803:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290098688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574299.775845:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290098688:12345-0@lo:400:kworker.0 Request processed in 44us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574299.775852:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1787574299.775872:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787574299.775898:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a3a6cd880 x1874407290098688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574299.775910:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290098688:0@lo:400:kworker.0 00000020:00000080:1.0:1787574299.951191:0:11668:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff9910b170 20000000:00000080:1.0:1787574299.951213:0:11668:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff982a41c57c00 uarg=0000000000000000 20000000:01000000:1.0:1787574299.951259:0:11668:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787574299.951266:0:11668:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787574299.951284:0:11668:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787574299.956554:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1787574299.959439:0:11668:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1787574299.967930:0:11668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1787574299.967997:0:11668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1787574299.968058:0:11668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1787574299.968079:0:11668:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787574299.968105:0:11668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982a42044a00/0xfe91058e646bf9b3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574299.968129:0:11668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a16143600/0xfe91058e646bf855 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eac8 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574299.968138:0:11668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a16142600/0xfe91058e646bf85c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eacf expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574299.968147:0:11668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a00031200/0xfe91058e646bf86a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf863 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574299.968155:0:11668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a42045e00/0xfe91058e646bf878 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf871 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574299.968162:0:11668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf886 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf87f expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574299.969076:0:11668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982a42044a00/0xfe91058e646bf9b3 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574299.969138:0:11668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf886 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf87f expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574299.969157:0:11668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf886 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf87f expref: 18 pid: 5823 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574299.970421:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874407290098816:0@lo:104: 00000100:00100000:0.0:1787574299.970506:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787574299.970644:0:11668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a42045e00/0xfe91058e646bf878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf871 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574299.970656:0:11668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a42045e00/0xfe91058e646bf878 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf871 expref: 18 pid: 5823 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574299.970665:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874407290098944:0@lo:104: 00000100:00100000:0.0:1787574299.970689:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787574299.974642:0:11668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a00031200/0xfe91058e646bf86a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646bf863 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574299.974666:0:11668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982a00031200/0xfe91058e646bf86a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646bf863 expref: 18 pid: 5824 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574299.974683:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f73b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874407290099072:0@lo:104: 00000100:00100000:0.0:1787574299.974758:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574299.976195:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290098816 00000100:00100000:3.0:1787574299.976211:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290098816 00000100:00100000:3.0:1787574299.976281:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290098944 00000100:00100000:3.0:1787574299.976284:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290098944 00000100:00100000:3.0:1787574299.976302:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787574299.976312:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+4:11668:x1874407290098816:12345-0@lo:104: 00010000:00010000:3.0:1787574299.976332:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf87f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574299.976441:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787574299.976448:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+4:11668:x1874407290098816:12345-0@lo:104: Request processed in 137us (5943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574299.976456:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787574299.976481:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787574299.976488:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+3:11668:x1874407290098944:12345-0@lo:104: 00010000:00010000:3.0:1787574299.976496:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a1d2abc00/0xfe91058e646bf871 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf878 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574299.976531:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787574299.976536:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+3:11668:x1874407290098944:12345-0@lo:104: Request processed in 49us (5846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574299.976541:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1787574299.976565:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787574299.976572:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf87f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574299.976579:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00031c00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1787574299.976583:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf87f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574299.976592:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf87f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574299.976599:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf87f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574299.976605:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787574299.976652:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf87f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574299.976659:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574299.976680:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf87f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574299.976687:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a00031c00/0xfe91058e646bf87f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574299.976703:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574299.976707:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a1d2abc00/0xfe91058e646bf871 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf878 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574299.976712:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2abc00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1787574299.976715:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2abc00/0xfe91058e646bf871 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf878 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574299.976722:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a1d2abc00/0xfe91058e646bf871 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf878 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574299.976728:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2abc00/0xfe91058e646bf871 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf878 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574299.976733:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787574299.976744:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a1d2abc00/0xfe91058e646bf871 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf878 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574299.976749:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574299.976761:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a1d2abc00/0xfe91058e646bf871 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf878 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574299.976776:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a1d2abc00/0xfe91058e646bf871 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf878 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574299.976785:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574299.976787:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574299.976788:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574299.976804:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290099200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574299.976841:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574299.976889:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290099328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574299.976909:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574299.976935:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290099200 00000100:00100000:3.0:1787574299.976939:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290099200 00010000:00010000:3.0:1787574299.976958:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf886 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf87f expref: 19 pid: 5823 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574299.976978:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290099328 00000100:00100000:3.0:1787574299.976981:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290099328 00010000:00010000:3.0:1787574299.976992:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a42045e00/0xfe91058e646bf878 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf871 expref: 20 pid: 5823 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574299.977008:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787574299.977013:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+20:3299:x1874407290099200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787574299.977024:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574299.977030:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf886 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf87f expref: 20 pid: 5823 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574299.977041:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf886 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf87f expref: 20 pid: 5823 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574299.977068:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574299.977097:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+20:3299:x1874407290099200:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574299.977103:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787574299.977117:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787574299.977123:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+19:3300:x1874407290099328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787574299.977131:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574299.977136:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a42045e00/0xfe91058e646bf878 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf871 expref: 19 pid: 5823 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574299.977144:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a42045e00/0xfe91058e646bf878 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf871 expref: 19 pid: 5823 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574299.977154:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574299.977198:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+19:3300:x1874407290099328:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574299.977204:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787574299.977245:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290099328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574299.977281:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290099200:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787574299.980737:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574299.981105:0:11668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a16142600/0xfe91058e646bf85c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eacf expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574299.981131:0:11668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982a16142600/0xfe91058e646bf85c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eacf expref: 12 pid: 5825 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574299.981151:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f71c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874407290099456:192.168.206.51@tcp:104: 00010000:00010000:0.0:1787574299.981292:0:11668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a16143600/0xfe91058e646bf855 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eac8 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574299.981323:0:11668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982a16143600/0xfe91058e646bf855 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eac8 expref: 12 pid: 5825 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574299.981332:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f71880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874407290099584:192.168.206.51@tcp:104: 00000100:00100000:0.0:1787574299.981360:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04915900 going to sleep for 11 seconds 00010000:00010000:0.0:1787574299.981392:0:11668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a1d2aa600/0xfe91058e646bf886 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf87f expref: 18 pid: 5823 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574299.981408:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874407290098816:0@lo:104: 00010000:00010000:0.0:1787574299.981421:0:11668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a42045e00/0xfe91058e646bf878 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf871 expref: 17 pid: 5823 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574299.981430:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874407290098944:0@lo:104: 00000100:00100000:2.0:1787574299.983310:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290099072 00000100:00100000:2.0:1787574299.983331:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290099072 00000100:00100000:3.0:1787574299.983553:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787574299.983583:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787574299.983598:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11b8c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+3:11668:x1874407290099072:12345-0@lo:104: 00010000:00010000:3.0:1787574299.983621:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf863 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf86a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574299.983774:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787574299.983780:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11b8c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7182851c-b624-4982-87cf-e891100b1765+3:11668:x1874407290099072:12345-0@lo:104: Request processed in 188us (9022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574299.983788:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787574299.984373:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574299.984383:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf863 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646bf86a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574299.984392:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00031600 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:1.0:1787574299.984397:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf863 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646bf86a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574299.984417:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf863 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646bf86a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574299.984425:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf863 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646bf86a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574299.984431:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787574299.984481:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf863 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf86a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574299.984488:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574299.984519:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf863 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf86a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574299.984525:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a00031600/0xfe91058e646bf863 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646bf86a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574299.984547:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574299.984548:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574299.984550:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574299.984559:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574299.984577:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290099712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574299.984630:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574299.984688:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290099712 00000100:00100000:1.0:1787574299.984694:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290099712 00010000:00010000:1.0:1787574299.984725:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a00031200/0xfe91058e646bf86a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf863 expref: 17 pid: 5824 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574299.984754:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787574299.984762:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+17:3300:x1874407290099712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787574299.984776:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574299.984782:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a00031200/0xfe91058e646bf86a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646bf863 expref: 17 pid: 5824 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574299.984793:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a00031200/0xfe91058e646bf86a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646bf863 expref: 17 pid: 5824 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574299.984809:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574299.984844:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+17:3300:x1874407290099712:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574299.984851:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787574299.984928:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290099712:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787574299.986231:0:11668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a00031200/0xfe91058e646bf86a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646bf863 expref: 16 pid: 5824 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574299.986256:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f73b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874407290099072:0@lo:104: 00000100:00100000:0.0:1787574299.986926:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574299.986960:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574299.987019:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272240512 00000100:00100000:1.0:1787574299.987030:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272240512 00010000:00010000:1.0:1787574299.987070:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a16142600/0xfe91058e646bf85c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eacf expref: 13 pid: 5825 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574299.987110:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272240640 00000100:00100000:1.0:1787574299.987114:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272240640 00010000:00010000:1.0:1787574299.987129:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a16143600/0xfe91058e646bf855 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eac8 expref: 14 pid: 5825 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574299.987154:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:1.0:1787574299.987193:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9891405-66e8-4ae2-851e-6434ae47d085+14:2350:x1874407272240512:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574299.987212:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574299.987219:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a16142600/0xfe91058e646bf85c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eacf expref: 14 pid: 5825 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574299.987231:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a16142600/0xfe91058e646bf85c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eacf expref: 14 pid: 5825 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574299.987255:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574299.987330:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9891405-66e8-4ae2-851e-6434ae47d085+14:2350:x1874407272240512:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 166us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574299.987339:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:1.0:1787574299.987359:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:1.0:1787574299.987366:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9891405-66e8-4ae2-851e-6434ae47d085+13:2350:x1874407272240640:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574299.987388:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574299.987394:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a16143600/0xfe91058e646bf855 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eac8 expref: 13 pid: 5825 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574299.987403:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a16143600/0xfe91058e646bf855 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eac8 expref: 13 pid: 5825 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574299.987416:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982a42044a00/0xfe91058e646bf9b3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574299.987424:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a42044a00/0xfe91058e646bf9b3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574299.987440:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a42044a00/0xfe91058e646bf9b3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574299.987448:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a42044a00/0xfe91058e646bf9b3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574299.987455:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982a42044a00/0xfe91058e646bf9b3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574299.987462:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982a42044a00/0xfe91058e646bf9b3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574299.987467:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a42044a00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574299.987472:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982a42044a00/0xfe91058e646bf9b3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574299.987480:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982a42044a00/0xfe91058e646bf9b3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574299.987500:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982a42044a00/0xfe91058e646bf9b3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574299.987512:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574299.987533:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9891405-66e8-4ae2-851e-6434ae47d085+13:2350:x1874407272240640:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 166us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574299.987539:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00010000:00010000:3.0:1787574299.987876:0:11668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a16142600/0xfe91058e646bf85c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eacf expref: 12 pid: 5825 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574299.987892:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f71c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874407290099456:192.168.206.51@tcp:104: 00010000:00010000:3.0:1787574299.987906:0:11668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a16143600/0xfe91058e646bf855 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eac8 expref: 11 pid: 5825 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574299.987916:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f71880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874407290099584:192.168.206.51@tcp:104: 00010000:00010000:3.0:1787574299.987954:0:11668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982a42044a00/0xfe91058e646bf9b3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574299.987964:0:11668:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982a42044a00/0xfe91058e646bf9b3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574299.987970:0:11668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982a42044a00/0xfe91058e646bf9b3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574299.987976:0:11668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a42044a00/0xfe91058e646bf9b3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574300.274850:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574300.274879:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290099840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574300.274968:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574300.275213:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290099840 00000100:00100000:2.0:1787574300.275224:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290099840 00000100:00100000:2.0:1787574300.275305:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787574300.275316:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290099840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787574300.275368:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787574300.275442:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290099840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574300.275449:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1787574300.275518:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a3a6cd880 x1874407290099840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574300.275539:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290099840:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787574300.389926:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1787574300.389944:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:3.0:1787574300.389970:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:1.0:1787574300.390354:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290099968:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787574300.390457:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574300.390841:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290099968 00000100:00100000:3.0:1787574300.390851:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290099968 00000100:00100000:3.0:1787574300.390907:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787574300.390918:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290099968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787574300.390949:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1787574300.390988:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8c3816, atime: 0x6a8c3816, ctime: 0x6a8c3816, blocks: 0x1 00010000:00010000:3.0:1787574300.391197:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b327b84/0xfe91058e646bf9ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574300.391217:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=276s v=(0 0) 00010000:00010000:3.0:1787574300.391222:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574300.391230:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b327b84/0xfe91058e646bf9ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574300.391251:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b327b84/0xfe91058e646bf9ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574300.391264:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b327b84/0xfe91058e646bf9ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574300.391283:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b327b84/0xfe91058e646bf9ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574300.391307:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787574300.391627:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574300.391636:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b327b84/0xfe91058e646bf9ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574300.391646:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16143600 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574300.391652:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b327b84/0xfe91058e646bf9ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574300.391663:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b327b84/0xfe91058e646bf9ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574300.391685:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b327b84/0xfe91058e646bf9ba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574300.391693:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b327b84/0xfe91058e646bf9ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574300.391735:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574300.391737:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574300.391739:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574300.392632:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1874407290099968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1710us (2169us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787574300.392650:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:1.0:1787574300.392791:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982a41f70700/2, rc 0, transno 4294967300 00000100:00100000:1.0:1787574300.392799:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290099968:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787574300.401789:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574300.955930:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574300.955983:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574300.956032:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574300.956075:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574300.956116:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272240896 00000100:00100000:1.0:1787574300.956129:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272240896 00000100:00100000:0.0:1787574300.956151:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272241152 00000100:00100000:0.0:1787574300.956158:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272241152 00000100:00100000:0.0:1787574300.956239:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:0.0:1787574300.956251:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2352:x1874407272241152:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574300.956351:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:0.0:1787574300.956358:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2352:x1874407272241152:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 108us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574300.956363:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2352:x1874407272240896:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574300.956371:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:1.0:1787574300.956399:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2352:x1874407272240896:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 39us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574300.956407:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00080000:1.0:1787574300.956429:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574300.956947:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272241024 00000100:00100000:3.0:1787574300.956954:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272241024 00000100:00100000:3.0:1787574300.957010:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:3.0:1787574300.957026:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2352:x1874407272241024:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:1.0:1787574300.957057:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574300.957072:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2352:x1874407272241024:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 47us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574300.957080:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:2.0:1787574300.957138:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272240768 00000100:00100000:2.0:1787574300.957144:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272240768 00000100:00100000:2.0:1787574300.957206:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 250 00000100:00100000:2.0:1787574300.957215:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+11:2352:x1874407272240768:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574300.957256:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+11:2352:x1874407272240768:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 42us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574300.957271:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 250 10000000:01000000:0.0:1787574301.041426:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787574301.041438:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982a3a5c3000 from 7 10000000:01000000:0.0:1787574301.041445:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787574301.041511:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42045800/0xfe91058e646bf9c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574301.041525:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a42045800/0xfe91058e646bf9c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574301.041538:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a42045800/0xfe91058e646bf9c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574301.041568:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290100096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787574301.041658:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574301.041728:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056a9240 going to sleep for 11 seconds 00000100:00100000:1.0:1787574301.042560:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290100096 00000100:00100000:1.0:1787574301.042573:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290100096 00000100:00100000:1.0:1787574301.042647:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787574301.042659:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+16:5827:x1874407290100096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574301.042675:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574301.042694:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a057e1a00/0xfe91058e646bf9c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf9c1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574301.042753:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a057e1a00/0xfe91058e646bf9c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf9c1 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574301.042772:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a057e1a00/0xfe91058e646bf9c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf9c1 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574301.042783:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1a00, rc 0) 00000100:00100000:1.0:1787574301.042854:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290100096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574301.042861:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787574301.043218:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290100096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574301.043238:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a42045800/0xfe91058e646bf9c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf9c8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574301.043248:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a42045800/0xfe91058e646bf9c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf9c8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574301.043345:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290100224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574301.043382:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574301.043414:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056a9240 going to sleep for 11 seconds 00000100:00100000:1.0:1787574301.043546:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290100224 00000100:00100000:1.0:1787574301.043551:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290100224 00000100:00100000:1.0:1787574301.043584:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787574301.043592:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290100224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574301.044095:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290100224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 502us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574301.044103:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787574301.045260:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290100224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574301.045344:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290100352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574301.045410:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574301.045466:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056a9240 going to sleep for 11 seconds 00000100:00100000:2.0:1787574301.045805:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290100352 00000100:00100000:2.0:1787574301.045820:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290100352 00000100:00100000:2.0:1787574301.045873:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787574301.045882:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290100352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574301.046114:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290100352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 225us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574301.046122:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787574301.046396:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290100352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574301.048521:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:11685:1874407290100480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574301.048612:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574301.048663:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a41df6900 going to sleep for 11 seconds 00000100:00100000:2.0:1787574301.048918:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290100480 00000100:00100000:2.0:1787574301.048928:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290100480 00000100:00100000:2.0:1787574301.048986:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787574301.048998:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+17:11685:x1874407290100480:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574301.049330:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+17:11685:x1874407290100480:12345-0@lo:502:llog_process_th.0 Request processed in 334us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574301.049339:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787574301.049583:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:11685:1874407290100480:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787574301.049632:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574301.049645:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574301.049647:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787574301.049667:0:11685:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff982a3a5c3000 00000020:00000080:1.0:1787574301.049670:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787574301.049792:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:11685:1874407290100608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574301.049831:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574301.049865:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a41df6900 going to sleep for 11 seconds 00000100:00100000:2.0:1787574301.052289:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290100608 00000100:00100000:2.0:1787574301.052305:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290100608 00000100:00100000:2.0:1787574301.052365:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787574301.052377:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+17:11685:x1874407290100608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574301.052689:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+17:11685:x1874407290100608:12345-0@lo:502:llog_process_th.0 Request processed in 314us (2855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574301.052698:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787574301.053955:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:11685:1874407290100608:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787574301.054027:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574301.054037:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574301.054040:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787574301.054046:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787574301.054885:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787574301.054916:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787574301.054930:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42045800/0xfe91058e646bf9c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf9c8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574301.054943:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a42045800/0xfe91058e646bf9c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf9c8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574301.054955:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787574301.054958:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982a41658000 from 7 10000000:01000000:0.0:1787574301.054961:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787574301.055001:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42045e00/0xfe91058e646bf9cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574301.055009:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a42045e00/0xfe91058e646bf9cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574301.055031:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a42045e00/0xfe91058e646bf9cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574301.055054:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290100736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787574301.055134:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574301.055195:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056a9240 going to sleep for 11 seconds 00000100:00100000:0.0:1787574301.055216:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290100736 00000100:00100000:0.0:1787574301.055224:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290100736 00000100:00100000:0.0:1787574301.055284:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787574301.055295:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a03487050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+17:5827:x1874407290100736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574301.055309:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574301.055331:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a42044a00/0xfe91058e646bf9d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf9cf expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574301.055357:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a42044a00/0xfe91058e646bf9d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf9cf expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574301.055369:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a42044a00/0xfe91058e646bf9d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf9cf expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574301.055378:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a42044a00, rc 0) 00000100:00100000:0.0:1787574301.055416:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a03487050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290100736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574301.055423:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787574301.055465:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290100736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574301.055480:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a42045e00/0xfe91058e646bf9cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf9d6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574301.055488:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a42045e00/0xfe91058e646bf9cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf9d6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574301.055554:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290100864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574301.055578:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574301.055590:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056a9240 going to sleep for 11 seconds 00000100:00100000:2.0:1787574301.055899:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290100864 00000100:00100000:2.0:1787574301.055906:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290100864 00000100:00100000:2.0:1787574301.055940:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787574301.055947:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a03484050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290100864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574301.056705:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a03484050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290100864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 756us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574301.056725:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787574301.056940:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290100864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574301.056987:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290100992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574301.057097:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574301.057192:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a41df6900 going to sleep for 11 seconds 00000100:00100000:0.0:1787574301.057234:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290100992 00000100:00100000:0.0:1787574301.057240:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290100992 00000100:00100000:0.0:1787574301.057281:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787574301.057289:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a03485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290100992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574301.057453:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a03485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290100992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574301.057467:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787574301.057888:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290100992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574301.059418:0:11686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:11686:1874407290101120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574301.059498:0:11686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574301.059544:0:11686:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a41df6300 going to sleep for 11 seconds 00000100:00100000:0.0:1787574301.059590:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290101120 00000100:00100000:0.0:1787574301.059598:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290101120 00000100:00100000:0.0:1787574301.059644:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787574301.059653:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+18:11686:x1874407290101120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574301.059884:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+18:11686:x1874407290101120:12345-0@lo:502:llog_process_th.0 Request processed in 232us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574301.059893:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787574301.060046:0:11686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:11686:1874407290101120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787574301.060361:0:11686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574301.060373:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574301.060376:0:11686:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787574301.060383:0:11686:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff982a41658000 00000020:00000080:1.0:1787574301.060386:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787574301.060464:0:11686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:11686:1874407290101248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574301.060504:0:11686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574301.060532:0:11686:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a41df6300 going to sleep for 11 seconds 00000100:00100000:0.0:1787574301.060583:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290101248 00000100:00100000:0.0:1787574301.060587:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290101248 00000100:00100000:0.0:1787574301.060622:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787574301.060630:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:11686:x1874407290101248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574301.060783:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+18:11686:x1874407290101248:12345-0@lo:502:llog_process_th.0 Request processed in 154us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574301.060790:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787574301.060911:0:11686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:11686:1874407290101248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787574301.060935:0:11686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574301.060940:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574301.060942:0:11686:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787574301.060946:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787574301.061446:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787574301.061472:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787574301.061485:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42045e00/0xfe91058e646bf9cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf9d6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574301.061499:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a42045e00/0xfe91058e646bf9cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf9d6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574301.061513:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787574301.061516:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982a0622a800 from 7 10000000:01000000:0.0:1787574301.061519:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787574301.061548:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf9dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574301.061564:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf9dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574301.061575:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf9dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574301.061593:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f71c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290101376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787574301.061630:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574301.061665:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056a9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574301.061847:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290101376 00000100:00100000:1.0:1787574301.061852:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290101376 00000100:00100000:1.0:1787574301.061886:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787574301.061893:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+18:5827:x1874407290101376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574301.061904:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574301.061918:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a057e1600/0xfe91058e646bf9e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646bf9dd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574301.061941:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a057e1600/0xfe91058e646bf9e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646bf9dd expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574301.062905:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a057e1600/0xfe91058e646bf9e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646bf9dd expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574301.062917:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1600, rc 0) 00000100:00100000:1.0:1787574301.062979:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290101376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1085us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574301.062987:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787574301.063303:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f71c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290101376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574301.063323:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf9dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf9e4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574301.063334:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf9dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf9e4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574301.063408:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f71c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290101504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574301.063441:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574301.063477:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056a9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574301.063520:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290101504 00000100:00100000:1.0:1787574301.063526:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290101504 00000100:00100000:1.0:1787574301.063564:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787574301.063572:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290101504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574301.063901:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290101504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 330us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574301.063915:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787574301.064057:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f71c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290101504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574301.064086:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f71c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290101632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574301.064328:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574301.064348:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056a9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574301.064385:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290101632 00000100:00100000:1.0:1787574301.064389:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290101632 00000100:00100000:1.0:1787574301.064419:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787574301.064426:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290101632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574301.064574:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:5827:x1874407290101632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574301.064581:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787574301.064869:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f71c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7182851c-b624-4982-87cf-e891100b1765:5827:1874407290101632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574301.073081:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:11688:1874407290101760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574301.073365:0:11688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574301.073414:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a41df66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574301.073487:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290101760 00000100:00100000:0.0:1787574301.073502:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290101760 00000100:00100000:0.0:1787574301.073561:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787574301.073572:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:11688:x1874407290101760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574301.078125:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:11688:x1874407290101760:12345-0@lo:502:llog_process_th.0 Request processed in 4541us (4747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574301.078144:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787574301.078370:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:11688:1874407290101760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787574301.078426:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574301.078438:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574301.078440:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787574301.078449:0:11688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff982a0622a800 00000020:00000080:1.0:1787574301.078452:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787574301.078574:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:11688:1874407290101888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574301.078626:0:11688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574301.078665:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a41df66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574301.079286:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290101888 00000100:00100000:0.0:1787574301.079294:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290101888 00000100:00100000:0.0:1787574301.079345:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787574301.079356:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:11688:x1874407290101888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574301.079594:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:11688:x1874407290101888:12345-0@lo:502:llog_process_th.0 Request processed in 239us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574301.079603:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787574301.079698:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7182851c-b624-4982-87cf-e891100b1765:11688:1874407290101888:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787574301.079736:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574301.079743:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574301.079745:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787574301.079749:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787574301.079996:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787574301.080096:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787574301.080117:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf9dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf9e4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574301.080130:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf9dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf9e4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787574301.086397:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787574301.297669:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3ad36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290102016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574301.297766:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574301.298058:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290102016 00000100:00100000:2.0:1787574301.298069:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290102016 00000100:00100000:2.0:1787574301.298162:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787574301.298203:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874407290102016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574301.298246:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787574301.298323:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874407290102016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574301.298330:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787574301.298558:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3ad36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290102016:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787574301.298668:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787574301.425398:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574301.656604:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574301.656749:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272241280 00000100:00100000:2.0:1787574301.656767:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272241280 00000100:00100000:2.0:1787574301.656870:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 266 00000100:00100000:2.0:1787574301.656883:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+11:5591:x1874407272241280:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574301.656906:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574301.656932:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a1d2aa400/0xfe91058e646bf9eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb1c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574301.656970:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a1d2aa400/0xfe91058e646bf9eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb1c expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574301.656983:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a1d2aa400/0xfe91058e646bf9eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb1c expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574301.657014:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a1d2aa400, rc 0) 00000100:00100000:2.0:1787574301.657073:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+12:5591:x1874407272241280:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 192us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574301.657081:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 266 00000100:00100000:3.0:1787574301.660719:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574301.660975:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272241408 00000100:00100000:1.0:1787574301.661005:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272241408 00000100:00100000:1.0:1787574301.661081:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 267 00000100:00100000:1.0:1787574301.661093:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+12:5591:x1874407272241408:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574301.661509:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+12:5591:x1874407272241408:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 417us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574301.661519:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 267 00000100:00100000:3.0:1787574301.666068:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574301.666306:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272241536 00000100:00100000:2.0:1787574301.666319:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272241536 00000100:00100000:2.0:1787574301.666453:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 268 00000100:00100000:2.0:1787574301.666467:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+12:5591:x1874407272241536:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574301.666826:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+12:5591:x1874407272241536:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 360us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574301.666835:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 268 00000100:00100000:2.0:1787574301.671853:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574301.672712:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272241664 00000100:00100000:0.0:1787574301.672738:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272241664 00000100:00100000:0.0:1787574301.672813:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 269 00000100:00100000:0.0:1787574301.672827:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+12:9959:x1874407272241664:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787574301.673293:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+12:9959:x1874407272241664:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 467us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574301.674244:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 269 00000100:00100000:3.0:1787574301.679471:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574301.679583:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272241792 00000100:00100000:1.0:1787574301.679595:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272241792 00000100:00100000:1.0:1787574301.679666:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 270 00000100:00100000:1.0:1787574301.679678:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+12:9959:x1874407272241792:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787574301.680159:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+12:9959:x1874407272241792:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 481us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574301.680200:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 270 00000100:00100000:3.0:1787574301.686890:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574301.687573:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272241920 00000100:00100000:0.0:1787574301.687589:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272241920 00000100:00100000:0.0:1787574301.687665:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 271 00000100:00100000:0.0:1787574301.687679:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+12:5591:x1874407272241920:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574301.687702:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574301.687727:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a00031c00/0xfe91058e646bf9f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb23 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574301.687776:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a00031c00/0xfe91058e646bf9f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb23 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574301.687789:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a00031c00/0xfe91058e646bf9f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb23 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574301.687800:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a00031c00, rc 0) 00000100:00100000:0.0:1787574301.687881:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:5591:x1874407272241920:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 205us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574301.687888:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 271 00000100:00100000:2.0:1787574301.689825:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574301.689969:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272242048 00000100:00100000:1.0:1787574301.689979:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272242048 00000100:00100000:1.0:1787574301.690036:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 272 00000100:00100000:1.0:1787574301.690048:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+13:5591:x1874407272242048:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574301.690429:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+13:5591:x1874407272242048:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 382us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574301.690438:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 272 00000100:00100000:1.0:1787574301.692307:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574301.692401:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272242176 00000100:00100000:3.0:1787574301.692412:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272242176 00000100:00100000:3.0:1787574301.692481:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 273 00000100:00100000:3.0:1787574301.692494:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+13:5591:x1874407272242176:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574301.692774:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+13:5591:x1874407272242176:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 282us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574301.692782:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 273 00000100:00100000:3.0:1787574301.698063:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574301.698402:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272242304 00000100:00100000:0.0:1787574301.698416:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272242304 00000100:00100000:0.0:1787574301.698491:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 274 00000100:00100000:0.0:1787574301.698503:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:9962:x1874407272242304:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787574301.698810:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:9962:x1874407272242304:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 308us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574301.698819:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 274 00000100:00100000:2.0:1787574301.704325:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574301.704497:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272242432 00000100:00100000:1.0:1787574301.704511:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272242432 00000100:00100000:1.0:1787574301.704628:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 275 00000100:00100000:1.0:1787574301.704642:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+13:9962:x1874407272242432:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787574301.704992:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+13:9962:x1874407272242432:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 352us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574301.705002:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 275 00000040:00080000:1.0:1787574302.129997:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787574302.449509:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574303.473785:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574304.497452:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574304.881791:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290102528:0@lo:400:kworker.0 00000100:00100000:3.0:1787574304.881885:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574304.881928:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290102272:0@lo:400:kworker.0 00000100:00100000:3.0:1787574304.881981:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787574304.881993:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290102144:0@lo:400:kworker.0 00000100:00100000:1.0:1787574304.882014:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574304.882048:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574304.882061:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290102784:0@lo:400:kworker.0 00000100:00100000:3.0:1787574304.882092:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874407290102656:0@lo:400:kworker.0 00000100:00100000:1.0:1787574304.882109:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574304.882150:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574304.882162:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574304.882199:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290102400:0@lo:400:kworker.0 00000100:00100000:3.0:1787574304.882253:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290102528 00000100:00100000:1.0:1787574304.882256:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574304.882263:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290102528 00000100:00100000:3.0:1787574304.882354:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290102784 00000100:00100000:3.0:1787574304.882360:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290102784 00000100:00100000:1.0:1787574304.882360:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290102144 00000100:00100000:1.0:1787574304.882372:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290102144 00000100:00100000:3.0:1787574304.882400:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787574304.882415:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1874407290102528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574304.882431:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787574304.882444:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04966c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:3300:x1874407290102144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574304.882491:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1874407290102528:12345-0@lo:400:kworker.0 Request processed in 80us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574304.882499:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787574304.882522:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787574304.882530:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290102784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574304.882592:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04966c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:3300:x1874407290102144:12345-0@lo:400:kworker.0 Request processed in 149us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574304.882608:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290102784:12345-0@lo:400:kworker.0 Request processed in 70us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574304.882612:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787574304.882627:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1787574304.882654:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787574304.882659:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574304.882711:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290102144:0@lo:400:kworker.0 00010000:00080000:1.0:1787574304.882718:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a3a6cea00 x1874407290102784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574304.882743:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290102528:0@lo:400:kworker.0 00000100:00100000:1.0:1787574304.882743:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290102784:0@lo:400:kworker.0 00000100:00100000:0.0:1787574304.882891:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290102272 00000100:00100000:0.0:1787574304.882897:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290102272 00000100:00100000:0.0:1787574304.882942:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290102656 00000100:00100000:0.0:1787574304.882946:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290102656 00000100:00100000:0.0:1787574304.882980:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290102400 00000100:00100000:0.0:1787574304.882983:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290102400 00000100:00100000:0.0:1787574304.883008:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787574304.883020:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290102272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574304.883085:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290102272:12345-0@lo:400:kworker.0 Request processed in 69us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574304.883092:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787574304.883106:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787574304.883113:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874407290102656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574304.883142:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787574304.883154:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874407290102656:12345-0@lo:400:kworker.0 Request processed in 40us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574304.883202:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787574304.883273:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290102400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574304.883282:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290102272:0@lo:400:kworker.0 00000100:00100000:2.0:1787574304.883432:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290102400:12345-0@lo:400:kworker.0 Request processed in 279us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574304.883440:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787574304.883479:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290102400:0@lo:400:kworker.0 00000100:00080000:3.0:1787574304.889943:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574304.890008:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874407290102656:0@lo:400:kworker.0 00000100:00100000:2.0:1787574305.396487:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574305.396513:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290102912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574305.396583:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574305.396703:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290102912 00000100:00100000:0.0:1787574305.396712:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290102912 00000100:00100000:0.0:1787574305.396760:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787574305.396771:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290102912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787574305.396804:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574305.396864:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290102912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574305.396871:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1787574305.396908:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a3a684380 x1874407290102912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574305.396941:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290102912:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787574305.488268:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:1.0:1787574305.521424:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574306.074537:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574306.074603:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574306.074649:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574306.074691:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574306.074740:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272242816 00000100:00100000:0.0:1787574306.074746:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272242688 00000100:00100000:3.0:1787574306.074754:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272242816 00000100:00100000:0.0:1787574306.074765:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272242688 00000100:00100000:0.0:1787574306.074855:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272242944 00000100:00100000:0.0:1787574306.074859:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272242944 00000100:00100000:0.0:1787574306.074893:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 108 00000100:00100000:0.0:1787574306.074903:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2353:x1874407272242688:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574306.074985:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2353:x1874407272242688:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 83us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574306.074993:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 108 00000100:00100000:0.0:1787574306.075010:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:0.0:1787574306.075017:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2353:x1874407272242944:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574306.075042:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2353:x1874407272242944:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 26us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574306.075048:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:3.0:1787574306.075213:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00080000:0.0:1787574306.075282:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787574306.075287:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574306.075374:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272242560 00000100:00100000:2.0:1787574306.075380:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272242560 00000100:00100000:3.0:1787574306.075398:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2353:x1874407272242816:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574306.075427:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 277 00000100:00100000:2.0:1787574306.075440:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04965450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+13:2353:x1874407272242560:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574306.075481:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2353:x1874407272242816:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 256us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574306.075490:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04965450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+13:2353:x1874407272242560:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 47us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574306.075501:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:2.0:1787574306.075508:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 277 00000100:00100000:0.0:1787574306.417748:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787574306.420045:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3ad35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290103040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574306.421152:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574306.421810:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290103040 00000100:00100000:2.0:1787574306.421823:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290103040 00000100:00100000:2.0:1787574306.421923:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787574306.421936:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290103040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574306.421985:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787574306.422046:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574306.422061:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290103040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574306.422069:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787574306.422125:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1787574306.422145:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982a41f70700, transno 4294967300 00000100:00100000:1.0:1787574306.422252:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3ad35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290103040:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787574306.546639:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574307.569737:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574308.594984:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574309.617403:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574310.002641:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290103552:0@lo:400:kworker.0 00000100:00100000:2.0:1787574310.002726:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574310.002806:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787574310.002812:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290103168:0@lo:400:kworker.0 00000100:00100000:2.0:1787574310.002842:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574310.002860:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874407290103680:0@lo:400:kworker.0 00000100:00100000:2.0:1787574310.002880:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574310.003073:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290103552 00000100:00100000:3.0:1787574310.003084:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290103552 00000100:00100000:3.0:1787574310.003160:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787574310.003190:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290103552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574310.003261:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290103552:12345-0@lo:400:kworker.0 Request processed in 73us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574310.003269:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787574310.003321:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290103552:0@lo:400:kworker.0 00000100:00080000:2.0:1787574310.003391:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574310.004134:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290103296:0@lo:400:kworker.0 00000100:00100000:0.0:1787574310.004267:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574310.004303:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a4122df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290103808:0@lo:400:kworker.0 00000100:00100000:0.0:1787574310.004360:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574310.004394:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574310.004401:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290103424:0@lo:400:kworker.0 00000100:00100000:0.0:1787574310.004427:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574310.004471:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290103168 00000100:00100000:0.0:1787574310.004478:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290103168 00000100:00100000:0.0:1787574310.004526:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787574310.004537:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04967450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:3300:x1874407290103168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574310.004591:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04967450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:3300:x1874407290103168:12345-0@lo:400:kworker.0 Request processed in 56us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574310.004598:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787574310.004637:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290103680 00000100:00100000:0.0:1787574310.004641:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290103680 00000100:00100000:0.0:1787574310.004676:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290103296 00000100:00100000:0.0:1787574310.004679:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290103296 00000100:00100000:0.0:1787574310.004692:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290103424 00000100:00100000:0.0:1787574310.004695:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290103424 00000100:00100000:0.0:1787574310.004709:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787574310.004715:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874407290103680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574310.004894:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874407290103680:12345-0@lo:400:kworker.0 Request processed in 179us (2012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574310.004901:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787574310.004917:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787574310.004925:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290103296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574310.004960:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290103296:12345-0@lo:400:kworker.0 Request processed in 37us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574310.004967:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787574310.004990:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787574310.004996:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290103424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574310.005026:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290103424:12345-0@lo:400:kworker.0 Request processed in 31us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574310.005031:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1787574310.005052:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574310.005082:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290103424:0@lo:400:kworker.0 00000100:00100000:0.0:1787574310.005095:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290103296:0@lo:400:kworker.0 00000100:00100000:3.0:1787574310.008537:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290103808 00000100:00100000:3.0:1787574310.008559:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290103808 00000100:00100000:3.0:1787574310.008673:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787574310.008686:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290103808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574310.008816:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290103808:12345-0@lo:400:kworker.0 Request processed in 133us (4455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574310.008824:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787574310.008906:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290103168:0@lo:400:kworker.0 00000100:00100000:3.0:1787574310.008928:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874407290103680:0@lo:400:kworker.0 00010000:00080000:3.0:1787574310.008982:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a4122df80 x1874407290103808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574310.008994:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a4122df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290103808:0@lo:400:kworker.0 00000100:00080000:2.0:1787574310.009260:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787574310.515369:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290103936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574310.515455:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574310.515551:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290103936 00000100:00100000:2.0:1787574310.515560:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290103936 00000100:00100000:2.0:1787574310.515627:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787574310.515639:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290103936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787574310.515674:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787574310.515730:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290103936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574310.515739:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1787574310.515776:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41f71880 x1874407290103936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574310.515794:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290103936:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787574310.642396:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574311.193991:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574311.194036:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574311.194077:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574311.194115:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574311.194216:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272243328 00000100:00100000:1.0:1787574311.194226:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272243328 00000100:00100000:2.0:1787574311.194230:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272243200 00000100:00100000:2.0:1787574311.194236:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272243200 00000100:00100000:2.0:1787574311.194300:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272243456 00000100:00100000:2.0:1787574311.194304:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272243456 00000100:00100000:0.0:1787574311.194305:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272243072 00000100:00100000:0.0:1787574311.194311:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272243072 00000100:00100000:0.0:1787574311.194392:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 279 00000100:00100000:0.0:1787574311.194404:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+13:2350:x1874407272243072:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574311.194472:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+13:2350:x1874407272243072:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 69us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574311.194479:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 279 00000100:00100000:0.0:1787574311.194512:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:0.0:1787574311.194520:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2350:x1874407272243200:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574311.194550:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2350:x1874407272243200:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 31us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574311.194573:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:1.0:1787574311.197464:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:1.0:1787574311.197482:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2350:x1874407272243328:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574311.197562:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2350:x1874407272243328:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 86us (3525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574311.197570:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:1.0:1787574311.201898:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:1.0:1787574311.201917:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2350:x1874407272243456:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574311.202027:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2350:x1874407272243456:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 117us (7911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574311.202033:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00080000:3.0:1787574311.202702:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787574311.202709:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574311.537639:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787574311.537666:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290104064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574311.537736:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574311.537856:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290104064 00000100:00100000:2.0:1787574311.537864:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290104064 00000100:00100000:2.0:1787574311.537924:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787574311.537934:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290104064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574311.537969:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787574311.538021:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290104064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574311.538029:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787574311.538248:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290104064:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787574311.669162:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787574312.369900:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787574312.689448:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574313.713488:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574314.737999:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574315.122162:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290104192:0@lo:400:kworker.0 00000100:00100000:2.0:1787574315.122282:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574315.122340:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874407290104704:0@lo:400:kworker.0 00000100:00100000:2.0:1787574315.122370:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574315.122394:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574315.122401:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290104576:0@lo:400:kworker.0 00000100:00100000:2.0:1787574315.122426:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574315.122549:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290104192 00000100:00100000:1.0:1787574315.122557:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290104192 00000100:00100000:1.0:1787574315.122612:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787574315.122621:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:3301:x1874407290104192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574315.122672:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:3301:x1874407290104192:12345-0@lo:400:kworker.0 Request processed in 52us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574315.122679:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787574315.122791:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290104192:0@lo:400:kworker.0 00000100:00100000:3.0:1787574315.122866:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290104576 00000100:00100000:3.0:1787574315.122870:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290104576 00000100:00100000:3.0:1787574315.122925:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787574315.122934:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290104576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574315.122979:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290104576:12345-0@lo:400:kworker.0 Request processed in 46us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574315.122985:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787574315.123018:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290104576:0@lo:400:kworker.0 00000100:00080000:2.0:1787574315.123128:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574315.123256:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290104320:0@lo:400:kworker.0 00000100:00100000:0.0:1787574315.123288:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574315.123318:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290104832:0@lo:400:kworker.0 00000100:00100000:0.0:1787574315.123343:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574315.123369:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574315.123376:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290104448:0@lo:400:kworker.0 00000100:00100000:0.0:1787574315.123399:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574315.123428:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290104704 00000100:00100000:0.0:1787574315.123432:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290104704 00000100:00100000:0.0:1787574315.123461:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290104320 00000100:00100000:0.0:1787574315.123464:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290104320 00000100:00100000:0.0:1787574315.123477:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290104448 00000100:00100000:0.0:1787574315.123479:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290104448 00000100:00100000:0.0:1787574315.123492:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787574315.123498:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874407290104704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574315.123534:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874407290104704:12345-0@lo:400:kworker.0 Request processed in 35us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574315.123540:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787574315.123555:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787574315.123561:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290104320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574315.123605:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290104320:12345-0@lo:400:kworker.0 Request processed in 43us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574315.123612:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787574315.123625:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787574315.123631:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290104448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574315.123657:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290104448:12345-0@lo:400:kworker.0 Request processed in 27us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574315.123663:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787574315.123704:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290104448:0@lo:400:kworker.0 00000100:00100000:0.0:1787574315.123715:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290104320:0@lo:400:kworker.0 00000100:00080000:2.0:1787574315.123922:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574315.124049:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290104832 00000100:00100000:3.0:1787574315.124054:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290104832 00000100:00100000:3.0:1787574315.124101:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787574315.124108:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290104832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574315.124159:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290104832:12345-0@lo:400:kworker.0 Request processed in 51us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574315.124197:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787574315.124313:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874407290104704:0@lo:400:kworker.0 00010000:00080000:1.0:1787574315.124350:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a3a6cfb80 x1874407290104832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574315.124361:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290104832:0@lo:400:kworker.0 00000100:00080000:2.0:1787574315.124419:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787574315.633630:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574315.633655:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290104960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574315.633723:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574315.633960:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290104960 00000100:00100000:0.0:1787574315.633968:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290104960 00000100:00100000:0.0:1787574315.634014:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787574315.634022:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290104960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787574315.634053:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574315.634102:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290104960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574315.634108:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1787574315.634238:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a05292680 x1874407290104960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574315.634258:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290104960:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787574315.761620:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574316.320281:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574316.320333:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574316.320424:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272243712 00000100:00100000:3.0:1787574316.320434:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272243712 00000100:00100000:3.0:1787574316.320511:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:3.0:1787574316.320520:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2352:x1874407272243712:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574316.320619:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2352:x1874407272243712:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 100us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574316.320626:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00080000:0.0:1787574316.320692:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574316.322382:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272243584 00000100:00100000:2.0:1787574316.322395:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272243584 00000100:00100000:2.0:1787574316.322459:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 281 00000100:00100000:2.0:1787574316.322469:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04965c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:2352:x1874407272243584:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574316.322543:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04965c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:2352:x1874407272243584:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 75us (2272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574316.322550:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 281 00000100:00100000:0.0:1787574316.340268:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574316.340379:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272243968 00000100:00100000:2.0:1787574316.340388:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272243968 00000100:00100000:2.0:1787574316.340499:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:2.0:1787574316.340509:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2352:x1874407272243968:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574316.340594:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2352:x1874407272243968:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 86us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574316.340600:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:3.0:1787574316.343297:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574316.343401:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272243840 00000100:00100000:1.0:1787574316.343410:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272243840 00000100:00080000:0.0:1787574316.344546:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574316.344553:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574316.344795:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:1.0:1787574316.344809:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2349:x1874407272243840:12345-192.168.206.51@tcp:9:kworker.0 00000020:00000080:1.0:1787574316.344851:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf92e 00000100:00080000:1.0:1787574316.344868:0:6683:0:(import.c:65:import_set_state_nolock()) ffff982906b88800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787574316.344921:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1787574316.345251:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+2:2349:x1874407272243840:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 445us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574316.345259:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00010000:00010000:2.0:1787574316.345655:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574316.660438:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574316.660462:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290105088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574316.660542:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574316.664714:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290105088 00000100:00100000:0.0:1787574316.664730:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290105088 00000100:00100000:0.0:1787574316.664822:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787574316.664833:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290105088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574316.664878:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574316.664976:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290105088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (4434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574316.664984:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787574316.665163:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290105088:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787574316.785406:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574317.814690:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574318.833400:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574319.857530:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574320.243013:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3ad35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290105344:0@lo:400:kworker.0 00000100:00100000:3.0:1787574320.243084:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3ad36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290105600:0@lo:400:kworker.0 00000100:00100000:2.0:1787574320.243085:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574320.243133:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574320.243150:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3ad34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290105856:0@lo:400:kworker.0 00000100:00100000:3.0:1787574320.243209:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787574320.243214:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574320.243244:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574320.243251:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3ad34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290105472:0@lo:400:kworker.0 00000100:00100000:2.0:1787574320.243274:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574320.243314:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290105344 00000100:00100000:2.0:1787574320.243321:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290105344 00000100:00100000:3.0:1787574320.243357:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3ad36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290105216:0@lo:400:kworker.0 00000100:00100000:2.0:1787574320.243364:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290105472 00000100:00100000:2.0:1787574320.243369:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290105472 00000100:00100000:2.0:1787574320.243405:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787574320.243412:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574320.243420:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290105344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574320.243445:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3ad34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874407290105728:0@lo:400:kworker.0 00000100:00100000:3.0:1787574320.243484:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574320.243485:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290105344:12345-0@lo:400:kworker.0 Request processed in 65us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574320.243495:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787574320.243511:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290105728 00000100:00100000:3.0:1787574320.243517:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290105728 00000100:00100000:2.0:1787574320.243518:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787574320.243529:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290105472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574320.243563:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290105472:12345-0@lo:400:kworker.0 Request processed in 37us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574320.243569:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787574320.243602:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3ad34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290105472:0@lo:400:kworker.0 00000100:00100000:2.0:1787574320.243611:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3ad35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290105344:0@lo:400:kworker.0 00000100:00100000:2.0:1787574320.243653:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290105600 00000100:00100000:2.0:1787574320.243656:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290105600 00000100:00100000:2.0:1787574320.243678:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290105856 00000100:00100000:2.0:1787574320.243692:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290105856 00000100:00100000:2.0:1787574320.243710:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787574320.243715:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290105600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574320.243746:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290105600:12345-0@lo:400:kworker.0 Request processed in 31us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574320.243752:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787574320.243761:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787574320.243766:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290105856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574320.243790:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290105856:12345-0@lo:400:kworker.0 Request processed in 24us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574320.243795:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1787574320.243818:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a3ad34380 x1874407290105856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574320.243829:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3ad34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290105856:0@lo:400:kworker.0 00000100:00100000:2.0:1787574320.243861:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290105216 00000100:00100000:2.0:1787574320.243864:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290105216 00000100:00100000:2.0:1787574320.243886:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787574320.243892:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04964050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:3300:x1874407290105216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574320.243922:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04964050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:3300:x1874407290105216:12345-0@lo:400:kworker.0 Request processed in 30us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574320.243927:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787574320.243964:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3ad36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290105216:0@lo:400:kworker.0 00000100:00100000:2.0:1787574320.243976:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3ad36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290105600:0@lo:400:kworker.0 00000100:00080000:0.0:1787574320.244068:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574320.244071:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574320.244073:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574320.245075:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787574320.245086:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874407290105728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574320.245156:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874407290105728:12345-0@lo:400:kworker.0 Request processed in 72us (1674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574320.245186:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787574320.245275:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3ad34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874407290105728:0@lo:400:kworker.0 00000100:00100000:0.0:1787574320.754492:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a05292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290105984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574320.755241:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574320.755417:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290105984 00000100:00100000:0.0:1787574320.755425:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290105984 00000100:00100000:0.0:1787574320.755468:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787574320.755477:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290105984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787574320.755511:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574320.755670:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290105984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 193us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574320.755679:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1787574320.755724:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a05292a00 x1874407290105984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574320.755742:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a05292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290105984:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787574320.824391:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f 00000020:00000080:2.0:1787574320.824401:0:6706:0:(genops.c:885:class_export_put()) final put ffff982906b8d000/a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f 00000020:00000080:2.0:1787574320.824448:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff982906b8d000/a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f for lustre-OST0000 00000020:00000080:2.0:1787574320.824502:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982906b88800 for lustre-OST0000 00010000:00010000:1.0:1787574320.881316:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574321.432575:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574321.432652:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574321.432686:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574321.432903:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272244352 00000100:00100000:3.0:1787574321.432913:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272244352 00000100:00100000:3.0:1787574321.432976:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272244224 00000100:00100000:3.0:1787574321.432979:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272244224 00000100:00100000:3.0:1787574321.433003:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:3.0:1787574321.433012:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2353:x1874407272244352:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574321.433082:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2353:x1874407272244352:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 71us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574321.433089:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:3.0:1787574321.433105:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 124 00000100:00100000:3.0:1787574321.433111:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2353:x1874407272244224:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574321.433132:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2353:x1874407272244224:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 21us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574321.433137:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 124 00000100:00100000:2.0:1787574321.435395:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272244096 00000100:00100000:2.0:1787574321.435411:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272244096 00000100:00100000:2.0:1787574321.435556:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 283 00000100:00100000:2.0:1787574321.435569:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04964850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+13:2353:x1874407272244096:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574321.435648:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04964850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+13:2353:x1874407272244096:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 82us (3083us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574321.435656:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 283 00000100:00080000:0.0:1787574321.438537:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574321.777752:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574321.777777:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290106112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574321.777847:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574321.777907:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290106112 00000100:00100000:1.0:1787574321.777914:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290106112 00000100:00100000:1.0:1787574321.777957:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787574321.777974:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290106112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574321.778011:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787574321.778064:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290106112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574321.778071:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787574321.778202:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290106112:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787574321.906798:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787574322.610364:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787574322.931324:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787574323.633329:0:11854:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:25:22 (1787574322) 00010000:00010000:2.0:1787574323.954003:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574324.977945:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574325.337751:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574325.337950:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272244480 00000100:00100000:3.0:1787574325.337960:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272244480 00000100:00100000:3.0:1787574325.338092:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:3.0:1787574325.338102:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:10230:x1874407272244480:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574325.338122:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574325.338154:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bf9f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb2a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.338240:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfa00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.338270:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfa00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.338283:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfa00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574325.338789:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787574325.338793:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787574325.338906:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfa00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.340257:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bf9f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb2a expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.340284:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfa00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb2a expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.340294:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a04dc0400) 00010000:00010000:3.0:1787574325.340297:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574325.340300:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142600, rc 0) 00000100:00100000:3.0:1787574325.340388:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:10230:x1874407272244480:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 2286us (2646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574325.340396:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00080000:0.0:1787574325.341380:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574325.349339:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574325.349554:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272244608 00000100:00100000:3.0:1787574325.349564:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272244608 00000100:00100000:3.0:1787574325.349623:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:3.0:1787574325.349634:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:10231:x1874407272244608:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574325.349654:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574325.349687:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfa07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb31 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.349753:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfa0e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.349767:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfa0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.349778:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfa0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.349792:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfa15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.349810:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfa15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.349817:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfa15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.350655:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143600/0xfe91058e646bfa1c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.350669:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143600/0xfe91058e646bfa1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.350676:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143600/0xfe91058e646bfa1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574325.350755:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787574325.350759:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787574325.350840:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143600/0xfe91058e646bfa1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.350857:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfa0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.350863:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfa0e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.350870:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfa0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.350876:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574325.350890:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfa0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.350898:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfa0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.350910:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a04dc0400) 00010000:00010000:3.0:1787574325.350913:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574325.350917:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfa0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.352288:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfa0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.352311:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfa15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.352318:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfa15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.352501:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfa15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.352524:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574325.352528:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfa15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.352535:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfa15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.352549:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff982a04dc0700) 00010000:00010000:3.0:1787574325.352552:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574325.352556:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfa15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.352561:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfa15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.352607:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfa07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb31 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.352621:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143600/0xfe91058e646bfa1c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb31 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574325.352628:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff982a04dc0e00) 00010000:00010000:3.0:1787574325.352631:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574325.352634:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16143600, rc 0) 00000100:00100000:3.0:1787574325.352714:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:10231:x1874407272244608:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 3081us (3396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574325.352723:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:2.0:1787574325.359322:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574325.359462:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272244864 00000100:00100000:1.0:1787574325.359472:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272244864 00000100:00100000:1.0:1787574325.359545:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:1.0:1787574325.359557:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:10231:x1874407272244864:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787574325.359577:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574325.359597:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646bfa23 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb38 expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574325.359666:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646bfa2a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574325.359679:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646bfa2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574325.359690:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646bfa2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574325.361113:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646bfa31 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574325.361141:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646bfa31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574325.361151:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646bfa31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574325.361406:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3ad34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290106624:0@lo:400:kworker.0 00010000:00010000:1.0:1787574325.361744:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1800/0xfe91058e646bfa38 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574325.361755:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1800/0xfe91058e646bfa38 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574325.361762:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1800/0xfe91058e646bfa38 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574325.361773:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787574325.361987:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646bfa2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574325.361996:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646bfa2a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574325.362003:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646bfa2a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574325.362008:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574325.362012:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646bfa2a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574325.362020:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646bfa2a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574325.362033:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff982a04dc0e00) 00010000:00010000:1.0:1787574325.362037:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574325.362042:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646bfa2a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574325.362059:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646bfa2a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574325.362074:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646bfa31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574325.362080:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646bfa31 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574325.362085:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3ad34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290106240:0@lo:400:kworker.0 00010000:00010000:1.0:1787574325.362090:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646bfa31 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574325.362098:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574325.362101:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646bfa31 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574325.362108:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646bfa31 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574325.362117:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff982a04da2d00) 00010000:00010000:1.0:1787574325.362120:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574325.362123:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646bfa31 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574325.362142:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646bfa31 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574325.362188:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574325.362249:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3ad35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874407290106752:0@lo:400:kworker.0 00000100:00100000:0.0:1787574325.362275:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574325.362311:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3ad35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290106368:0@lo:400:kworker.0 00000100:00100000:0.0:1787574325.362335:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574325.362350:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3ad36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290106880:0@lo:400:kworker.0 00000100:00100000:0.0:1787574325.362371:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574325.362389:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574325.362395:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3ad34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290106496:0@lo:400:kworker.0 00000100:00100000:0.0:1787574325.362414:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574325.362461:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290106240 00000100:00100000:0.0:1787574325.362469:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290106240 00000100:00100000:0.0:1787574325.362512:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787574325.362521:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:3301:x1874407290106240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574325.362542:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574325.362691:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290106752 00000100:00100000:3.0:1787574325.362702:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290106752 00000100:00100000:0.0:1787574325.362715:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:3301:x1874407290106240:12345-0@lo:400:kworker.0 Request processed in 193us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574325.362724:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787574325.362739:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290106368 00000100:00100000:3.0:1787574325.362744:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290106368 00000100:00100000:3.0:1787574325.362760:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290106496 00000100:00100000:3.0:1787574325.362763:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290106496 00000100:00100000:3.0:1787574325.362790:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787574325.362797:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874407290106752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574325.362845:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874407290106752:12345-0@lo:400:kworker.0 Request processed in 48us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574325.362853:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787574325.362871:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787574325.362877:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a05292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290106368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574325.362914:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a05292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290106368:12345-0@lo:400:kworker.0 Request processed in 37us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574325.362919:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787574325.362937:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787574325.362945:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290106496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574325.362957:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290106880 00000100:00100000:2.0:1787574325.362964:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290106880 00000100:00100000:3.0:1787574325.362979:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290106496:12345-0@lo:400:kworker.0 Request processed in 34us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574325.362987:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787574325.362996:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290106624 00000100:00100000:2.0:1787574325.363000:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290106624 00000100:00100000:2.0:1787574325.363024:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787574325.363031:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290106880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574325.363047:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787574325.363058:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290106624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574325.363071:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290106880:12345-0@lo:400:kworker.0 Request processed in 40us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574325.363079:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1787574325.363108:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574325.363112:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574325.363116:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574325.363121:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290106624:12345-0@lo:400:kworker.0 Request processed in 62us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574325.363139:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787574325.363192:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3ad34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290106496:0@lo:400:kworker.0 00000100:00100000:3.0:1787574325.363216:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3ad34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290106240:0@lo:400:kworker.0 00000100:00100000:3.0:1787574325.363238:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3ad35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874407290106752:0@lo:400:kworker.0 00000100:00100000:0.0:1787574325.363339:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3ad35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290106368:0@lo:400:kworker.0 00010000:00080000:0.0:1787574325.363362:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a3ad36680 x1874407290106880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574325.363373:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3ad36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290106880:0@lo:400:kworker.0 00000100:00100000:2.0:1787574325.363865:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3ad34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290106624:0@lo:400:kworker.0 00010000:00010000:1.0:1787574325.363876:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646bfa23 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb38 expref: 10 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574325.363902:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1800/0xfe91058e646bfa38 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb38 expref: 9 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574325.363919:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982a04da2c00) 00010000:00010000:1.0:1787574325.363922:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574325.363925:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1800, rc 0) 00000100:00100000:1.0:1787574325.363977:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:10231:x1874407272244864:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 4422us (4665us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787574325.363984:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:3.0:1787574325.371336:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574325.372000:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272244992 00000100:00100000:2.0:1787574325.372011:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272244992 00000100:00100000:2.0:1787574325.372083:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:2.0:1787574325.372094:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:10231:x1874407272244992:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787574325.372239:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:10231:x1874407272244992:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 146us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574325.372246:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00000040:00080000:2.0:1787574325.746457:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787574325.873428:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290107008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574325.873516:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574325.876498:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290107008 00000100:00100000:1.0:1787574325.876513:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290107008 00000100:00100000:1.0:1787574325.876569:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787574325.876580:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290107008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574325.876633:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787574325.876729:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290107008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (3213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574325.876735:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1787574325.877013:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a41d84380 x1874407290107008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574325.877037:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290107008:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787574325.954455:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:2.0:1787574326.001420:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574326.556863:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574326.556911:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574326.556941:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574326.556975:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272245120 00000100:00100000:3.0:1787574326.556987:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272245120 00000100:00100000:3.0:1787574326.557049:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 285 00000100:00100000:3.0:1787574326.557062:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+13:2352:x1874407272245120:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574326.557162:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+13:2352:x1874407272245120:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 103us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574326.557202:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 285 00000100:00100000:3.0:1787574326.557418:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272245376 00000100:00100000:3.0:1787574326.557422:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272245376 00000100:00100000:3.0:1787574326.557870:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272245248 00000100:00100000:3.0:1787574326.557875:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272245248 00000100:00100000:3.0:1787574326.557903:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 128 00000100:00100000:3.0:1787574326.557911:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2352:x1874407272245376:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574326.557959:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2352:x1874407272245376:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 49us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574326.557966:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 128 00000100:00100000:3.0:1787574326.557980:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00100000:3.0:1787574326.557987:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2352:x1874407272245248:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574326.558011:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2352:x1874407272245248:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 26us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574326.558026:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00080000:3.0:1787574326.559801:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574326.900383:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290107136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574326.900472:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574326.900701:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290107136 00000100:00100000:0.0:1787574326.900711:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290107136 00000100:00100000:0.0:1787574326.900775:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787574326.900787:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290107136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574326.900830:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574326.900878:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290107136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574326.900884:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787574326.901272:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290107136:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787574327.026668:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574327.323219:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574327.323297:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272245504 00000100:00100000:3.0:1787574327.323307:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272245504 00000100:00100000:3.0:1787574327.323389:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:3.0:1787574327.323401:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:10274:x1874407272245504:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1787574327.323421:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574327.323441:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfa46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb3f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.323503:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfa4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.323518:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfa4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.323528:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfa4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.323543:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfa54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.323551:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfa54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.323572:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfa54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.323854:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfa4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.323863:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfa4d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.323870:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfa4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.323889:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574327.323894:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfa4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.323902:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfa4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.323914:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a04dc0400) 00010000:00010000:3.0:1787574327.323917:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574327.323921:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfa4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.323927:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfa4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.323941:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfa54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.323948:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfa54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.323960:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfa54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.323965:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574327.323969:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfa54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.323975:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfa54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.323984:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff982a04dc0c00) 00010000:00010000:3.0:1787574327.323987:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574327.323990:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfa54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.323996:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfa54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.324028:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfa46 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb3f expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.324038:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a04dc0400) 00010000:00010000:3.0:1787574327.324041:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574327.324045:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfa46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb3f expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.324054:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142000, rc 0) 00000100:00100000:3.0:1787574327.324116:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:10274:x1874407272245504:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 717us (906us total) trans 0 rc 301/301 00000100:00100000:3.0:1787574327.324145:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00080000:0.0:1787574327.324619:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574327.337388:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574327.337571:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272245760 00000100:00100000:2.0:1787574327.337582:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272245760 00000100:00100000:2.0:1787574327.337768:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:2.0:1787574327.337779:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:10274:x1874407272245760:12345-192.168.206.51@tcp:36:lfs.0 00010000:00010000:2.0:1787574327.337833:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574327.337858:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfa00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb2a expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.337876:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a04dc0400) 00010000:00010000:2.0:1787574327.337896:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787574327.338239:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfa5b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.338253:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfa5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.338262:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfa5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.338288:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bfa62 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.338296:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bfa62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.338303:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bfa62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574327.343607:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787574327.343909:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfa5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.343922:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfa5b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.343932:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfa5b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.343938:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2ab800 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574327.343942:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfa5b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.343951:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfa5b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.343969:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34300) 00010000:00010000:2.0:1787574327.343972:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574327.343976:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfa5b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.344000:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfa5b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787574327.344022:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5853715 reply state 00000000f47b90f5 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bfa62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574327.344032:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787574327.344210:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:10274:x1874407272245760:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 6429us (6827us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787574327.344220:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00010000:00010000:0.0:1787574327.350486:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bfa62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.350504:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bfa62 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.350513:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bfa62 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.350519:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2aaa00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574327.350523:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bfa62 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.350542:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bfa62 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.350561:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff982a03b34000) 00010000:00010000:0.0:1787574327.350564:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574327.350568:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bfa62 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.350575:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bfa62 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574327.443796:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574327.444247:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272245888 00000100:00100000:2.0:1787574327.444261:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272245888 00000100:00100000:2.0:1787574327.444332:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:2.0:1787574327.444344:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:10282:x1874407272245888:12345-192.168.206.51@tcp:101:lctl.0 00010000:00010000:2.0:1787574327.444367:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574327.444388:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa800/0xfe91058e646bfa69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb46 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.444450:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab400/0xfe91058e646bfa70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.444464:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab400/0xfe91058e646bfa70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.444475:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab400/0xfe91058e646bfa70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574327.444535:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787574327.444540:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787574327.444603:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab400/0xfe91058e646bfa70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.444641:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa800/0xfe91058e646bfa69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb46 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.444662:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab400/0xfe91058e646bfa70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb46 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.444672:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34300) 00010000:00010000:2.0:1787574327.444675:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787574327.444679:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a1d2ab400, rc 0) 00000100:00100000:2.0:1787574327.444735:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:10282:x1874407272245888:12345-192.168.206.51@tcp:101:lctl.0 Request processed in 393us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574327.444742:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:3.0:1787574327.499065:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574327.499216:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272246016 00000100:00100000:0.0:1787574327.499230:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272246016 00000100:00100000:0.0:1787574327.499314:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:0.0:1787574327.499327:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:10288:x1874407272246016:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1787574327.499355:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574327.499382:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfa77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb4d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499484:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfa7e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499502:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfa7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499517:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfa7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499536:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfa85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499562:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfa85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499569:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfa85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499715:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031600/0xfe91058e646bfa8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499723:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031600/0xfe91058e646bfa8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499729:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031600/0xfe91058e646bfa8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574327.499768:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787574327.499772:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787574327.499832:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031600/0xfe91058e646bfa8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499847:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfa7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499854:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfa7e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499860:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfa7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499866:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030e00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574327.499870:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfa7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499886:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfa7e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499901:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34300) 00010000:00010000:0.0:1787574327.499904:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574327.499910:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfa7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499917:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfa7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499933:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfa85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499939:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfa85 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499945:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfa85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499950:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574327.499953:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfa85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499958:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfa85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499965:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff982a0de1d000) 00010000:00010000:0.0:1787574327.499968:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574327.499970:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfa85 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.499986:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfa85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.500022:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfa77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb4d expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.500036:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031600/0xfe91058e646bfa8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb4d expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.500043:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:0.0:1787574327.500045:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787574327.500047:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a00031600, rc 0) 00000100:00100000:0.0:1787574327.500137:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+10:10288:x1874407272246016:12345-192.168.206.51@tcp:101:bash.0 Request processed in 813us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574327.500145:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:3.0:1787574327.505855:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574327.506065:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272246272 00000100:00100000:2.0:1787574327.506081:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272246272 00000100:00100000:2.0:1787574327.506203:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:2.0:1787574327.506217:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+10:10288:x1874407272246272:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1787574327.506244:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574327.506270:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa800/0xfe91058e646bfa93 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb54 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.506469:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa600/0xfe91058e646bfa9a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.506486:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa600/0xfe91058e646bfa9a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.506500:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa600/0xfe91058e646bfa9a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.506692:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2abc00/0xfe91058e646bfaa1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.506715:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2abc00/0xfe91058e646bfaa1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.506727:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2abc00/0xfe91058e646bfaa1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787574327.507455:0:5830:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787574327.507613:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfaa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.507624:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfaa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.507633:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfaa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.507665:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa600/0xfe91058e646bfa9a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.507673:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa600/0xfe91058e646bfa9a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.507681:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa600/0xfe91058e646bfa9a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.507687:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2aa600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574327.507691:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa600/0xfe91058e646bfa9a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.507708:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa600/0xfe91058e646bfa9a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.507720:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:2.0:1787574327.507723:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574327.507728:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa600/0xfe91058e646bfa9a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.507734:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa600/0xfe91058e646bfa9a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787574327.507748:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007492b81d reply state 00000000d9d7004b transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2abc00/0xfe91058e646bfaa1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574327.507757:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787574327.507794:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa800/0xfe91058e646bfa93 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb54 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.507808:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfaa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb54 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.507816:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:2.0:1787574327.507818:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574327.507820:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a1d2ab800, rc 0) 00000100:00100000:2.0:1787574327.507902:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+13:10288:x1874407272246272:12345-192.168.206.51@tcp:101:bash.0 Request processed in 1688us (2063us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787574327.507910:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 40 00010000:00010000:1.0:1787574327.509822:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2abc00/0xfe91058e646bfaa1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.509839:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2abc00/0xfe91058e646bfaa1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.509847:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2abc00/0xfe91058e646bfaa1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.509876:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2abc00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574327.509881:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2abc00/0xfe91058e646bfaa1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.509889:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2abc00/0xfe91058e646bfaa1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.509907:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982a03b34900) 00010000:00010000:1.0:1787574327.509911:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574327.509915:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2abc00/0xfe91058e646bfaa1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.509921:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2abc00/0xfe91058e646bfaa1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574327.512264:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574327.512420:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272246400 00000100:00100000:2.0:1787574327.512450:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272246400 00000100:00100000:2.0:1787574327.512515:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:2.0:1787574327.512523:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1874407272246400:12345-192.168.206.51@tcp:8:bash.0 00010000:00080000:2.0:1787574327.512552:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:2.0:1787574327.512580:0:6681:0:(genops.c:1385:class_connect()) connect: client a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f, cookie 0xfe91058e646bfab6 00002000:00100000:2.0:1787574327.512591:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f/ffff982a2e0db800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787574327.512600:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787574327.512852:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787574327.512919:0:6681:0:(import.c:65:import_set_state_nolock()) ffff982a41240800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574327.512993:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2349:x1874407272246400:12345-192.168.206.51@tcp:8:bash.0 Request processed in 467us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574327.513002:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:3.0:1787574327.517819:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574327.517998:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272246528 00000100:00100000:2.0:1787574327.518011:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272246528 00000100:00080000:3.0:1787574327.518155:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574327.519607:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:2.0:1787574327.519636:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:0:x1874407272246528:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1787574327.519661:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574327.519697:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1546f98/0xfe91058e646bfabd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb5b expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787574327.519731:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787574327.519757:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=303s v=(0 0) 00010000:00010000:2.0:1787574327.519762:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574327.519774:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1546f98/0xfe91058e646bfabd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb5b expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.519821:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d1546f98/0xfe91058e646bfabd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb5b expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.519838:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a1d2aa800, rc 0) 00000100:00100000:2.0:1787574327.523157:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:0:x1874407272246528:12345-192.168.206.51@tcp:101:bash.0 Request processed in 3518us (5334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574327.523205:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:2.0:1787574327.527400:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574327.527587:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272246656 00000100:00100000:0.0:1787574327.527601:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272246656 00000100:00100000:0.0:1787574327.527671:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:0.0:1787574327.527682:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:10288:x1874407272246656:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1787574327.527703:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574327.527728:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2257577/0xfe91058e646bfac4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb62 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.527767:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1546f98/0xfe91058e646bfabd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb5b expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.527796:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574327.527801:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574327.527808:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2257577/0xfe91058e646bfac4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb62 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.527849:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d1546f98/0xfe91058e646bfabd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb5b expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.527864:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d1546f98/0xfe91058e646bfabd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb5b expref: 8 pid: 6683 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574327.527880:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6681:1874407290107264:192.168.206.51@tcp:104: 00000100:00100000:0.0:1787574327.528000:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a1697d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574327.530592:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6681:1874407290107264:192.168.206.51@tcp:104: 00010000:00010000:0.0:1787574327.530638:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d2257577/0xfe91058e646bfac4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb62 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.530665:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a00030200, rc 0) 00000100:00100000:0.0:1787574327.530744:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:10288:x1874407272246656:12345-192.168.206.51@tcp:101:bash.0 Request processed in 3063us (3357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574327.530754:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:0.0:1787574327.533599:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574327.533800:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272246784 00000100:00100000:1.0:1787574327.533814:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272246784 00010000:00010000:1.0:1787574327.533897:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d1546f98/0xfe91058e646bfabd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb5b expref: 8 pid: 6683 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574327.533957:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:1.0:1787574327.533969:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2350:x1874407272246784:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574327.533990:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574327.534019:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d1546f98/0xfe91058e646bfabd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb5b expref: 8 pid: 6683 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.534036:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d1546f98/0xfe91058e646bfabd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb5b expref: 8 pid: 6683 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.534084:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1546f98/0xfe91058e646bfabd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb5b expref: 8 pid: 6683 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.534104:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574327.534109:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574327.534131:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2257577/0xfe91058e646bfac4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb62 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.534142:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2257577/0xfe91058e646bfac4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb62 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.534235:0:8453:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d2257577/0xfe91058e646bfac4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb62 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574327.534253:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8453:1874407290107392:192.168.206.51@tcp:105: 00000100:00100000:1.0:1787574327.534367:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04915d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574327.539799:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574327.539939:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8453:1874407290107392:192.168.206.51@tcp:105: 00010000:00010000:1.0:1787574327.539972:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574327.540050:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2350:x1874407272246784:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 6082us (6464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574327.540064:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:0.0:1787574327.540064:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272247040 00000100:00100000:0.0:1787574327.540082:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272247040 00000100:00100000:0.0:1787574327.540196:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:0.0:1787574327.540209:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+12:10288:x1874407272247040:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:0.0:1787574327.540624:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+13:10288:x1874407272247040:12345-192.168.206.51@tcp:35:bash.0 Request processed in 417us (839us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787574327.540632:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:2.0:1787574327.623922:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574327.624245:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272247296 00000100:00100000:3.0:1787574327.624258:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272247296 00000100:00100000:3.0:1787574327.624385:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:3.0:1787574327.624399:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+13:10298:x1874407272247296:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1787574327.624432:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574327.624459:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfacb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb69 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574327.624637:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787574327.625060:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfacb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb69 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.625080:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34300) 00010000:00010000:3.0:1787574327.625084:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787574327.625090:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfacb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb69 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.625107:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142400, rc 0) 00000100:00100000:3.0:1787574327.625326:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+14:10298:x1874407272247296:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 929us (1542us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1787574327.625349:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:3.0:1787574327.630237:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574327.630398:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272247552 00000100:00100000:0.0:1787574327.630412:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272247552 00000100:00100000:0.0:1787574327.630546:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:0.0:1787574327.630560:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+14:10298:x1874407272247552:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1787574327.630936:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+15:10298:x1874407272247552:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 377us (711us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787574327.630945:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:2.0:1787574327.702655:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574327.702807:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272247680 00000100:00100000:3.0:1787574327.702821:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272247680 00000100:00100000:3.0:1787574327.702897:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:3.0:1787574327.702910:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+15:10304:x1874407272247680:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1787574327.702943:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574327.702971:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfad9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb70 expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.703256:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfae0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.703274:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.703287:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574327.703356:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787574327.703360:0:7646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787574327.703386:0:7646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.703417:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfad9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb70 expref: 17 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.703452:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfae0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb70 expref: 16 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.703481:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:3.0:1787574327.703485:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574327.703489:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142000, rc 0) 00000100:00100000:3.0:1787574327.703570:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+16:10304:x1874407272247680:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 662us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574327.703579:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:1.0:1787574327.706775:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574327.706886:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272247936 00000100:00100000:0.0:1787574327.706899:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272247936 00000100:00100000:0.0:1787574327.707006:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:0.0:1787574327.707021:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+16:10304:x1874407272247936:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1787574327.707051:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574327.707089:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfae7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb77 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.707271:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfaee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.707293:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfaee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.707306:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfaee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574327.707350:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787574327.707531:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfae7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb77 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.707550:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfaee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb77 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.707560:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:0.0:1787574327.707563:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574327.707567:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a00031200, rc 0) 00000100:00100000:0.0:1787574327.707649:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+18:10304:x1874407272247936:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 631us (886us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787574327.707657:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:0.0:1787574327.714481:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574327.715220:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272248064 00000100:00100000:1.0:1787574327.715236:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272248064 00000100:00100000:1.0:1787574327.715346:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:3.0:1787574327.715357:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574327.715361:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+18:2350:x1874407272248064:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574327.715382:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574327.715414:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfaee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb77 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.715436:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:1.0:1787574327.715442:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574327.715508:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+17:2350:x1874407272248064:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 153us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574327.716273:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:2.0:1787574327.716284:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272248320 00000100:00100000:2.0:1787574327.716292:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272248320 00000100:00100000:3.0:1787574327.716425:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:3.0:1787574327.716449:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+17:10304:x1874407272248320:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1787574327.716477:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574327.716499:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfafc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb7e expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.716631:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bfb03 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.716647:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bfb03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.716658:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bfb03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574327.716672:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787574327.716819:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfafc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb7e expref: 20 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.716838:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bfb03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb7e expref: 19 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.716858:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:3.0:1787574327.716861:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787574327.716865:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16143800, rc 0) 00000100:00100000:3.0:1787574327.716919:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:10304:x1874407272248320:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 485us (1565us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787574327.716926:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:3.0:1787574327.722573:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574327.723094:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272248448 00000100:00100000:1.0:1787574327.723107:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272248448 00000100:00100000:1.0:1787574327.723243:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:1.0:1787574327.723257:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2353:x1874407272248448:12345-192.168.206.51@tcp:1:lfs.0 00010000:00010000:1.0:1787574327.723328:0:8472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e61c285c/0xfe91058e646bfb11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.723353:0:8472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2257577/0xfe91058e646bfac4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb62 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.723363:0:8472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574327.723368:0:8472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787574327.723372:0:8472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e61c285c/0xfe91058e646bfb11 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.723416:0:8472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d2257577/0xfe91058e646bfac4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb62 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.723448:0:8472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d2257577/0xfe91058e646bfac4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb62 expref: 7 pid: 6681 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574327.723471:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8472:1874407290107520:192.168.206.51@tcp:104: 00000100:00100000:1.0:1787574327.723593:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04915d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574327.730443:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574327.730555:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272248576 00000100:00100000:2.0:1787574327.730567:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272248576 00002000:00100000:2.0:1787574327.730638:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff982a41f6dc00 x1874407272248576/t0(0) o4->a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp:98/0 lens 504/0 e 0 to 0 dl 1787574338 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787574327.730650:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a41f6dc00 with x1874407272248576 ext(0->12) 00010000:00010000:2.0:1787574327.730661:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d2257577/0xfe91058e646bfac4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb62 expref: 8 pid: 6681 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.730678:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d2257577/0xfe91058e646bfac4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb62 expref: 8 pid: 6681 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787574327.730687:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff982a41f6dc00 00000100:00100000:2.0:1787574327.730739:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:2.0:1787574327.730750:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2350:x1874407272248576:12345-192.168.206.51@tcp:4:lfs.0 00000100:00100000:1.0:1787574327.732246:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8472:1874407290107520:192.168.206.51@tcp:104: 00010000:00010000:1.0:1787574327.732282:0:8472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e61c285c/0xfe91058e646bfb11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1787574327.780871:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f 00000100:00100000:2.0:1787574327.782342:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:2350:x1874407272248576:12345-192.168.206.51@tcp:4:lfs.0 Request processed in 51579us (51901us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787574327.782361:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00002000:00100000:2.0:1787574327.782378:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff982a41f6dc00 x1874407272248576/t4294967299(0) o4->a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp:98/0 lens 504/448 e 0 to 0 dl 1787574338 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787574327.782390:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a41f6dc00 with x1874407272248576 ext(0->12) 00010000:00010000:2.0:1787574327.782404:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d2257577/0xfe91058e646bfac4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb62 expref: 9 pid: 6681 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.782425:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d2257577/0xfe91058e646bfac4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb62 expref: 9 pid: 6681 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787574327.782434:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff982a41f6dc00 00000100:00100000:3.0:1787574327.786068:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574327.786626:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272248704 00000100:00100000:2.0:1787574327.786640:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272248704 00010000:00010000:2.0:1787574327.786698:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d2257577/0xfe91058e646bfac4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb62 expref: 9 pid: 6681 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574327.786750:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:2.0:1787574327.786763:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:2352:x1874407272248704:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574327.786792:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787574327.786816:0:5817:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787574327.786833:0:5817:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787574327 00002000:00010000:2.0:1787574327.786836:0:5817:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787574327 00002000:00010000:2.0:1787574327.786838:0:5817:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787574327 00010000:00010000:2.0:1787574327.786846:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d2257577/0xfe91058e646bfac4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb62 expref: 9 pid: 6681 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.786863:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d2257577/0xfe91058e646bfac4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb62 expref: 9 pid: 6681 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.786893:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2257577/0xfe91058e646bfac4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb62 expref: 9 pid: 6681 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.786910:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574327.786915:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574327.786923:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e61c285c/0xfe91058e646bfb11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.786933:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e61c285c/0xfe91058e646bfb11 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.786978:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574327.787055:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2352:x1874407272248704:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 295us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574327.787063:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00010000:00010000:3.0:1787574327.787453:0:8472:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e61c285c/0xfe91058e646bfb11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.787465:0:8472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e61c285c/0xfe91058e646bfb11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.787499:0:8472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e61c285c/0xfe91058e646bfb11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.787509:0:8472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e61c285c/0xfe91058e646bfb11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.787517:0:8472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e61c285c/0xfe91058e646bfb11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.787525:0:8472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1c00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:3.0:1787574327.787530:0:8472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e61c285c/0xfe91058e646bfb11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.787547:0:8472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e61c285c/0xfe91058e646bfb11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.787563:0:8472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e61c285c/0xfe91058e646bfb11 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574327.787571:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e61c285c/0xfe91058e646bfb11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574327.787643:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2353:x1874407272248448:12345-192.168.206.51@tcp:1:lfs.0 Request processed in 64389us (65083us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574327.787652:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:3.0:1787574327.795280:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574327.795495:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272248960 00000100:00100000:2.0:1787574327.795510:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272248960 00000100:00100000:2.0:1787574327.795583:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:2.0:1787574327.795603:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:10304:x1874407272248960:12345-192.168.206.51@tcp:35:lfs.0 00000004:00010000:2.0:1787574327.795692:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bfb03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb7e expref: 19 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787574327.795996:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1787574327.796050:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1787574327.797800:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1787574327.797901:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa800/0xfe91058e646bfb18 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.797926:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfaa8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb54 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.797937:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa800/0xfe91058e646bfb18 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.797989:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfaa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb54 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.798008:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfaa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb54 expref: 23 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574327.798025:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3ad35f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1874407290107648:192.168.206.51@tcp:104: 00000100:00100000:2.0:1787574327.800834:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98290619c000 going to sleep for 11 seconds 00000100:00100000:2.0:1787574327.803243:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3ad35f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1874407290107648:192.168.206.51@tcp:104: 00010000:00010000:2.0:1787574327.803284:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa800/0xfe91058e646bfb18 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574327.804989:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574327.805365:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272249088 00000100:00100000:0.0:1787574327.805378:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272249088 00010000:00010000:0.0:1787574327.805433:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfaa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb54 expref: 24 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574327.805496:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:0.0:1787574327.805508:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+24:2351:x1874407272249088:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574327.805525:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574327.805533:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfaa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb54 expref: 24 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.805568:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfaa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb54 expref: 24 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.805596:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfaa8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb54 expref: 24 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.805618:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:0.0:1787574327.805624:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa800/0xfe91058e646bfb18 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.805635:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa800/0xfe91058e646bfb18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.805644:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa800/0xfe91058e646bfb18 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.805680:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787574327.805724:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa800/0xfe91058e646bfb18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.805743:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa800/0xfe91058e646bfb18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574327.805765:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+23:2351:x1874407272249088:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 259us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574327.805776:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00000001:00080000:2.0:1787574327.805939:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1787574327.806264:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1787574327.806400:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3ad35f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1874407290107776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787574327.808271:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574327.808333:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98290619c480 going to sleep for 11 seconds 00000100:00100000:3.0:1787574327.808485:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290107776 00000100:00100000:3.0:1787574327.808495:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290107776 00000100:00100000:3.0:1787574327.808804:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787574327.808816:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1874407290107776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787574327.809210:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1874407290107776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 396us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574327.809218:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787574327.809305:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787574327.809496:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3ad35f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1874407290107776:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787574327.810367:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1787574327.810488:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1874407290107904:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787574327.810573:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574327.810617:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056a8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787574327.810707:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290107904 00000100:00100000:3.0:1787574327.810717:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290107904 00000100:00100000:3.0:1787574327.810805:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787574327.810815:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1874407290107904:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787574327.811130:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1874407290107904:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 315us (556us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787574327.811139:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787574327.811250:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1874407290107904:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787574327.811338:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1787574327.811397:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa800/0xfe91058e646bfb18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.811413:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa800/0xfe91058e646bfb18 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.811422:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa800/0xfe91058e646bfb18 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.811444:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2aa800 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574327.811450:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa800/0xfe91058e646bfb18 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.811458:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa800/0xfe91058e646bfb18 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.811484:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:1.0:1787574327.811488:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787574327.811495:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa800/0xfe91058e646bfb18 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.811503:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa800/0xfe91058e646bfb18 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787574327.811734:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787574327.813405:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1787574327.813432:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 303988265137ns, next at 304988259081ns, rc = 0 00000001:00080000:1.0:1787574327.813449:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1787574327.813525:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:1.0:1787574327.813530:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787574327.813547:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bfb03 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb7e expref: 27 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574327.813750:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+26:10304:x1874407272248960:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 18154us (18481us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787574327.813761:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000020:00080000:1.0:1787574327.813771:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787574327.824450:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574327.826511:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272249216 00000100:00100000:2.0:1787574327.826531:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272249216 00000100:00100000:2.0:1787574327.826737:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:2.0:1787574327.826754:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+26:10304:x1874407272249216:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1787574327.826789:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574327.826824:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2abc00/0xfe91058e646bfb1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb85 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.826909:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2abc00/0xfe91058e646bfb1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb85 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.826928:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2abc00/0xfe91058e646bfb1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb85 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.826951:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:2.0:1787574327.826954:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787574327.826959:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a1d2abc00, rc 0) 00000100:00100000:2.0:1787574327.827053:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+27:10304:x1874407272249216:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 304us (2617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574327.827079:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:2.0:1787574327.835320:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574327.835434:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272249472 00000100:00100000:0.0:1787574327.835447:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272249472 00000100:00100000:0.0:1787574327.835523:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:0.0:1787574327.835537:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a03535850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+27:10304:x1874407272249472:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1787574327.835883:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a03535850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+28:10304:x1874407272249472:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 342us (569us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1787574327.835912:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:3.0:1787574327.903914:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574327.904080:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272249728 00000100:00100000:1.0:1787574327.904094:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272249728 00000100:00100000:1.0:1787574327.904207:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:1.0:1787574327.904224:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+28:10314:x1874407272249728:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1787574327.904256:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574327.904556:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfb26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb8c expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574327.904887:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787574327.905159:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfb26 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb8c expref: 30 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.905221:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34300) 00010000:00010000:1.0:1787574327.905225:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787574327.905231:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfb26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb8c expref: 30 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574327.905247:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1200, rc 0) 00000100:00100000:1.0:1787574327.905483:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+29:10314:x1874407272249728:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1260us (1581us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1787574327.905493:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:3.0:1787574327.911888:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574327.913037:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272249856 00000100:00100000:0.0:1787574327.913054:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272249856 00000100:00100000:0.0:1787574327.913148:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:0.0:1787574327.913162:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+29:10314:x1874407272249856:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:0.0:1787574327.913301:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfb34 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913322:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfb34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913335:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfb34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913351:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913358:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913364:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913497:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfb42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913506:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfb42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913513:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfb42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574327.913579:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfb42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913592:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfb34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913599:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfb34 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913605:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfb34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913611:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574327.913615:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfb34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913622:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfb34 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913636:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:0.0:1787574327.913639:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574327.913644:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfb34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913650:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfb34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913663:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913668:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913680:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913685:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030e00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574327.913687:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913693:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913700:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982a0de1d000) 00010000:00010000:0.0:1787574327.913703:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574327.913705:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913710:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913726:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfb42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913731:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfb42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913736:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfb42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913740:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00031200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574327.913743:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfb42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913757:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfb42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913766:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:0.0:1787574327.913768:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574327.913771:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfb42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574327.913776:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfb42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574327.914697:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+29:10314:x1874407272249856:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 1530us (2905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574327.914710:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:2.0:1787574327.922376:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574327.923305:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272250112 00000100:00100000:0.0:1787574327.923321:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272250112 00000100:00100000:1.0:1787574327.923489:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:1.0:1787574327.923504:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+29:10314:x1874407272250112:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1787574327.924368:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+30:10314:x1874407272250112:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 864us (2001us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1787574327.924380:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:3.0:1787574327.983906:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574327.984032:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272250368 00000100:00100000:2.0:1787574327.984048:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272250368 00000100:00100000:2.0:1787574327.984226:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:2.0:1787574327.984240:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+30:10317:x1874407272250368:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1787574327.984287:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574327.984313:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa800/0xfe91058e646bfb49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb93 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.984408:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfb50 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.984427:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfb50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.984439:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfb50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.984455:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bfb57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.984462:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bfb57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.984468:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bfb57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.984618:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa600/0xfe91058e646bfb5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.984643:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa600/0xfe91058e646bfb5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.984651:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa600/0xfe91058e646bfb5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574327.984663:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787574327.984810:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfb50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.984819:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfb50 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.984826:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfb50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.984832:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2ab800 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574327.984837:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfb50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.984844:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfb50 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.984861:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:2.0:1787574327.984864:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574327.984870:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfb50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.984877:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab800/0xfe91058e646bfb50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.984892:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bfb57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.984905:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bfb57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.984911:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bfb57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.984916:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2aaa00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574327.984919:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bfb57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.984926:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bfb57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.984934:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982a03b34200) 00010000:00010000:2.0:1787574327.984937:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574327.984940:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bfb57 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.984946:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aaa00/0xfe91058e646bfb57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.985000:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa800/0xfe91058e646bfb49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb93 expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.985016:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa600/0xfe91058e646bfb5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb93 expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.985024:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:2.0:1787574327.985026:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574327.985036:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a1d2aa600, rc 0) 00000100:00100000:2.0:1787574327.985131:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+32:10317:x1874407272250368:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 894us (1239us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787574327.985141:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:3.0:1787574327.989492:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574327.990241:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272250496 00000100:00100000:2.0:1787574327.990257:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272250496 00000100:00100000:2.0:1787574327.990351:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:2.0:1787574327.990364:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+32:10317:x1874407272250496:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:2.0:1787574327.990495:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646bfb6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.990514:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646bfb6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.990527:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646bfb6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.990562:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646bfb6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.990569:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646bfb6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.990576:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646bfb6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.990583:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fba00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574327.990588:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646bfb6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.990596:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646bfb6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.990619:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:2.0:1787574327.990621:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787574327.990627:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646bfb6c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574327.990634:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646bfb6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574327.990746:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+32:10317:x1874407272250496:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 384us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574327.990754:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:3.0:1787574327.994054:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574327.994227:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272250752 00000100:00100000:0.0:1787574327.994239:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272250752 00000100:00100000:0.0:1787574327.994306:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:0.0:1787574327.994318:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+32:10317:x1874407272250752:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1787574327.994652:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+33:10317:x1874407272250752:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 334us (609us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787574327.994661:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00010000:00010000:2.0:1787574328.049908:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574328.260980:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574328.261133:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272251008 00000100:00100000:1.0:1787574328.261198:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272251008 00000100:00100000:1.0:1787574328.261285:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:1.0:1787574328.261298:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+33:10348:x1874407272251008:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:1.0:1787574328.261333:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574328.261362:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfb73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eb9a expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.261518:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfb7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.261534:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfb7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.261549:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfb7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574328.261571:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787574328.261765:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfb73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb9a expref: 36 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.261789:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfb7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb9a expref: 35 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.261799:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:1.0:1787574328.261802:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787574328.261806:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1c00, rc 0) 00000100:00100000:1.0:1787574328.261889:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+35:10348:x1874407272251008:12345-192.168.206.51@tcp:101:cat.0 Request processed in 594us (924us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1787574328.261897:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:3.0:1787574328.264776:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574328.264855:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272251264 00000100:00100000:0.0:1787574328.264869:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272251264 00000100:00100000:0.0:1787574328.264942:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:0.0:1787574328.264954:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+35:10348:x1874407272251264:12345-192.168.206.51@tcp:35:cat.0 00000100:00100000:0.0:1787574328.265319:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+36:10348:x1874407272251264:12345-192.168.206.51@tcp:35:cat.0 Request processed in 366us (555us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1787574328.265329:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1787574328.267430:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574328.267866:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272251392 00000100:00100000:1.0:1787574328.267878:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272251392 00000100:00100000:1.0:1787574328.267961:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:1.0:1787574328.267973:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a063a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+36:2352:x1874407272251392:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574328.267992:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574328.268024:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfb7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb9a expref: 36 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.268048:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:1.0:1787574328.268054:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574328.268247:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a063a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+35:2352:x1874407272251392:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 275us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574328.268254:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:3.0:1787574328.348838:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574328.349105:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272251648 00000100:00100000:0.0:1787574328.349130:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272251648 00000100:00100000:0.0:1787574328.349233:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:0.0:1787574328.349247:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+35:10354:x1874407272251648:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1787574328.349279:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574328.349283:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787574328.349316:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfae0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb70 expref: 35 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574328.349341:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:0.0:1787574328.349347:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574328.349363:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfb88 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eba1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574328.349493:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb8f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574328.349511:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa600/0xfe91058e646bfb5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb93 expref: 35 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574328.349520:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb8f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574328.349563:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa600/0xfe91058e646bfb5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb93 expref: 35 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574328.349614:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa600/0xfe91058e646bfb5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb93 expref: 35 pid: 5830 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574328.349632:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41f6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874407290108032:192.168.206.51@tcp:104: 00000100:00100000:0.0:1787574328.349753:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0828c900 going to sleep for 11 seconds 00000100:00100000:0.0:1787574328.354552:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41f6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874407290108032:192.168.206.51@tcp:104: 00010000:00010000:0.0:1787574328.354592:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb8f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574328.355690:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574328.355786:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272251776 00000100:00100000:1.0:1787574328.355798:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272251776 00010000:00010000:1.0:1787574328.355862:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa600/0xfe91058e646bfb5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb93 expref: 36 pid: 5830 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574328.355909:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:1.0:1787574328.355921:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+36:2350:x1874407272251776:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574328.355937:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574328.355945:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa600/0xfe91058e646bfb5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb93 expref: 36 pid: 5830 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.355959:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa600/0xfe91058e646bfb5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb93 expref: 36 pid: 5830 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.356020:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2aa600/0xfe91058e646bfb5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb93 expref: 36 pid: 5830 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.356041:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:1.0:1787574328.356047:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb8f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.356059:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.356067:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb8f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.356102:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574328.356215:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+35:2350:x1874407272251776:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 295us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574328.356222:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00010000:00010000:3.0:1787574328.356407:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.356416:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574328.356439:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787574328.356648:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfb88 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eba1 expref: 36 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.356667:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eba1 expref: 35 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.356674:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:3.0:1787574328.356684:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787574328.356687:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a00030e00, rc 0) 00000100:00100000:3.0:1787574328.356717:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+35:10354:x1874407272251648:12345-192.168.206.51@tcp:101:dd.0 Request processed in 7474us (7894us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787574328.356724:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:3.0:1787574328.373703:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574328.373817:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272252032 00000100:00100000:1.0:1787574328.373831:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272252032 00000100:00100000:1.0:1787574328.373903:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:1.0:1787574328.373913:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+35:10354:x1874407272252032:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:1.0:1787574328.374268:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfb9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.374288:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfb9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.374301:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfb9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787574328.374366:0:7646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1787574328.374388:0:7646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ac75e2f reply state 00000000e7555cd7 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfb9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574328.374397:0:7646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787574328.374505:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+38:10354:x1874407272252032:12345-192.168.206.51@tcp:36:dd.0 Request processed in 591us (813us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1787574328.374512:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 52 00000020:00080000:1.0:1787574328.374517:0:7646:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787574328.386470:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfb9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574328.386496:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfb9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574328.386506:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfb9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574328.386514:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574328.386519:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfb9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574328.386528:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfb9d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574328.386551:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:0.0:1787574328.386554:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574328.386560:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfb9d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574328.386587:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfb9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574328.625988:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574328.626272:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272252160 00000100:00100000:2.0:1787574328.626285:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272252160 00000100:00100000:2.0:1787574328.626430:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:2.0:1787574328.626632:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+37:10368:x1874407272252160:12345-192.168.206.51@tcp:101:stat.0 00010000:00010000:2.0:1787574328.626664:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574328.626691:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646bfba4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eba8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574328.626790:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646bfbab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574328.626808:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646bfbab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574328.626821:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646bfbab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574328.626858:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646bfbb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574328.626867:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646bfbb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574328.626874:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646bfbb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574328.626987:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646bfbb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574328.626999:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb8f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eba1 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574328.627159:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646bfbb9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574328.627235:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eba1 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574328.627253:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb8f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eba1 expref: 38 pid: 5831 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574328.627271:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3ad35f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874407290108160:192.168.206.51@tcp:104: 00000100:00100000:2.0:1787574328.627948:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff98290619c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574328.630661:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574328.630987:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272252416 00000100:00100000:0.0:1787574328.631000:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272252416 00000100:00100000:0.0:1787574328.631082:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:0.0:1787574328.631095:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+39:5589:x1874407272252416:12345-192.168.206.51@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787574328.631604:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+40:5589:x1874407272252416:12345-192.168.206.51@tcp:35:ldlm_bl.0 Request processed in 510us (955us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1787574328.631613:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:3.0:1787574328.633565:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3ad35f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874407290108160:192.168.206.51@tcp:104: 00010000:00010000:3.0:1787574328.634343:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646bfbb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574328.639099:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574328.643401:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272252544 00000100:00100000:1.0:1787574328.643425:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272252544 00010000:00010000:1.0:1787574328.643497:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb8f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eba1 expref: 40 pid: 5831 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574328.644151:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:1.0:1787574328.644191:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+40:2350:x1874407272252544:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574328.644211:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574328.644221:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb8f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eba1 expref: 40 pid: 5831 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.644237:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eba1 expref: 40 pid: 5831 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.644277:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfb8f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eba1 expref: 40 pid: 5831 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.644300:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:1.0:1787574328.644321:0:8453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646bfbb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.644333:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646bfbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.644341:0:8453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646bfbb9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.644380:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574328.644475:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+39:2350:x1874407272252544:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 311us (5700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574328.644483:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00010000:00010000:3.0:1787574328.645397:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646bfbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.645411:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646bfbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574328.645470:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787574328.645475:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787574328.645528:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646bfbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.645545:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646bfbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.645556:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646bfbab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.645564:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646bfbab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.645602:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646bfbab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.645609:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fa000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574328.645615:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646bfbab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.645624:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646bfbab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.645639:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:3.0:1787574328.645642:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574328.645647:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646bfbab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.645655:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646bfbab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.645671:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646bfbb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.645677:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646bfbb2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.645684:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646bfbb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.645689:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fac00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574328.645692:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646bfbb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.645708:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646bfbb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.645716:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982a03b34200) 00010000:00010000:3.0:1787574328.645718:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574328.645721:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646bfbb2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.645727:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646bfbb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.645786:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646bfba4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eba8 expref: 39 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.645802:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646bfbb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eba8 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.645810:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:3.0:1787574328.645812:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574328.645815:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fbc00, rc 0) 00000100:00100000:3.0:1787574328.645901:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+38:10368:x1874407272252160:12345-192.168.206.51@tcp:101:stat.0 Request processed in 19274us (19926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574328.645910:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:0.0:1787574328.716058:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574328.718027:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272252800 00000100:00100000:1.0:1787574328.718045:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272252800 00000100:00100000:1.0:1787574328.718345:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:1.0:1787574328.718357:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+38:10374:x1874407272252800:12345-192.168.206.51@tcp:36:truncate.0 00010000:00010000:1.0:1787574328.718692:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574328.718732:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646bfbb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eba8 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.718756:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:1.0:1787574328.718763:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787574328.719630:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfbc0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.719650:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfbc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.719663:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfbc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787574328.719749:0:7646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1787574328.719775:0:7646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000990394c reply state 0000000086eaed1a transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfbc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574328.719785:0:7646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787574328.723613:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+40:10374:x1874407272252800:12345-192.168.206.51@tcp:36:truncate.0 Request processed in 5244us (7552us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1787574328.723627:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 54 00000020:00080000:1.0:1787574328.723638:0:7646:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787574328.729549:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfbc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.729571:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfbc0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.729580:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfbc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.729587:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574328.729594:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfbc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.729602:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfbc0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.729625:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:1.0:1787574328.729629:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574328.729634:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfbc0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574328.729641:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfbc0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574328.880669:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574328.880851:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272252928 00000100:00100000:3.0:1787574328.880865:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272252928 00000100:00100000:3.0:1787574328.880949:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:3.0:1787574328.880961:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+39:10388:x1874407272252928:12345-192.168.206.51@tcp:101:stat.0 00010000:00010000:3.0:1787574328.881016:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574328.881043:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfbc7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ebaf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.881134:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfbce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.881150:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfbce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.881407:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfbce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.881429:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.881502:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.881511:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.881999:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfbdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.882010:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfbdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.882017:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfbdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574328.882061:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1787574328.882075:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787574328.882102:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfbdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.882125:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfbdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.882135:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfbce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.882142:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfbce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.882150:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfbce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.882157:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574328.882162:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfbce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.882318:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfbce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.882333:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:3.0:1787574328.882337:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574328.882343:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfbce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.882350:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfbce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.882367:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.882385:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.882392:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.882398:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16143a00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574328.882402:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.882409:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.882418:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982a04dc0c00) 00010000:00010000:3.0:1787574328.882421:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574328.882424:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbd5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.882431:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.882707:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfbc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebaf expref: 41 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.882727:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfbdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebaf expref: 40 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574328.882737:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:3.0:1787574328.882740:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574328.882750:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16143000, rc 0) 00000100:00100000:3.0:1787574328.883130:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+40:10388:x1874407272252928:12345-192.168.206.51@tcp:101:stat.0 Request processed in 2168us (2472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574328.883141:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:0.0:1787574328.958559:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574328.958785:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272253184 00000100:00100000:2.0:1787574328.958801:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272253184 00000100:00100000:2.0:1787574328.958902:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:2.0:1787574328.958916:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+40:10398:x1874407272253184:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1787574328.958941:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574328.958970:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa800/0xfe91058e646bfbe3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ebb6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574328.959123:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787574328.959319:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa800/0xfe91058e646bfbe3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebb6 expref: 42 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574328.959337:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34300) 00010000:00010000:2.0:1787574328.959340:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787574328.959346:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa800/0xfe91058e646bfbe3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebb6 expref: 42 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574328.959363:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fa800, rc 0) 00000100:00100000:2.0:1787574328.959433:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+41:10398:x1874407272253184:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 521us (887us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1787574328.959442:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:0.0:1787574328.962396:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574328.962506:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272253440 00000100:00100000:1.0:1787574328.962518:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272253440 00000100:00100000:1.0:1787574328.962587:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:1.0:1787574328.962598:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+41:10398:x1874407272253440:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1787574328.962930:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+42:10398:x1874407272253440:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 332us (546us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1787574328.962939:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:0.0:1787574329.028456:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574329.032032:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272253696 00000100:00100000:2.0:1787574329.032053:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272253696 00000100:00080000:0.0:1787574329.032274:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574329.032448:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:3.0:1787574329.032464:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+42:10403:x1874407272253696:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1787574329.032497:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574329.032527:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfbf1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ebbd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.032661:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbf8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.032678:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfbdc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebaf expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.032687:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbf8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.032729:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfbdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebaf expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.032744:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfbdc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebaf expref: 43 pid: 5831 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574329.032760:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d56300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874407290108288:192.168.206.51@tcp:104: 00000100:00100000:3.0:1787574329.032881:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a069f8180 going to sleep for 11 seconds 00000100:00100000:0.0:1787574329.037707:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574329.037816:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272253824 00000100:00100000:1.0:1787574329.037828:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272253824 00010000:00010000:1.0:1787574329.037880:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfbdc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebaf expref: 44 pid: 5831 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574329.037929:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:1.0:1787574329.037941:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+44:2350:x1874407272253824:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574329.037959:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574329.037967:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfbdc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebaf expref: 44 pid: 5831 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.037982:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfbdc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebaf expref: 44 pid: 5831 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.038009:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:1.0:1787574329.038014:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbf8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.038024:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.038049:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbf8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.038071:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574329.038201:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+44:2350:x1874407272253824:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 261us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574329.038209:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 40 00010000:00010000:3.0:1787574329.039006:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfbdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebaf expref: 43 pid: 5831 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574329.039055:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d56300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874407290108288:192.168.206.51@tcp:104: 00010000:00010000:3.0:1787574329.039081:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.039100:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.039107:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574329.039146:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787574329.039385:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfbf1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebbd expref: 44 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.039403:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbf8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebbd expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.039413:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:3.0:1787574329.039416:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787574329.039419:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16143a00, rc 0) 00000100:00100000:3.0:1787574329.041242:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+43:10403:x1874407272253696:12345-192.168.206.51@tcp:101:bash.0 Request processed in 8768us (12787us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1787574329.041257:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:0.0:1787574329.051254:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574329.051360:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272254080 00000100:00100000:1.0:1787574329.051374:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272254080 00000100:00100000:1.0:1787574329.051453:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:1.0:1787574329.051466:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+43:10403:x1874407272254080:12345-192.168.206.51@tcp:36:bash.0 00010000:00010000:1.0:1787574329.051805:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfc06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.051828:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfc06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.051842:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfc06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787574329.051901:0:7646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1787574329.051930:0:7646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058a9483d reply state 00000000db2add19 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfc06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574329.051941:0:7646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787574329.052058:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+46:10403:x1874407272254080:12345-192.168.206.51@tcp:36:bash.0 Request processed in 594us (817us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1787574329.052067:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 58 00000020:00080000:1.0:1787574329.052072:0:7646:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787574329.067634:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfc06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.067672:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfc06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.067738:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfc06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.067746:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574329.067751:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfc06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.067760:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfc06 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.067782:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:3.0:1787574329.067785:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574329.067791:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfc06 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.067798:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfc06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574329.069399:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574329.069829:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272254208 00000100:00100000:2.0:1787574329.069843:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272254208 00000100:00100000:2.0:1787574329.069921:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:2.0:1787574329.069935:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+45:10403:x1874407272254208:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1787574329.069969:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574329.069995:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646bfc0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ebc4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.070142:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646bfc14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.070161:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbf8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebbd expref: 46 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.070212:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646bfc14 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.070254:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbf8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebbd expref: 46 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.070270:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbf8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebbd expref: 46 pid: 5831 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574329.070286:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874407290108416:192.168.206.51@tcp:104: 00000100:00100000:2.0:1787574329.070498:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff98290619c540 going to sleep for 11 seconds 00010000:00010000:3.0:1787574329.074068:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574329.074858:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574329.074983:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272254336 00000100:00100000:3.0:1787574329.074994:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272254336 00010000:00010000:3.0:1787574329.075041:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbf8 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebbd expref: 47 pid: 5831 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574329.075087:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:3.0:1787574329.075118:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+47:2351:x1874407272254336:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574329.075136:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574329.075144:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbf8 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebbd expref: 47 pid: 5831 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.075209:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbf8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebbd expref: 47 pid: 5831 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.075237:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:3.0:1787574329.075243:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646bfc14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.075254:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646bfc14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.075262:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646bfc14 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.075284:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574329.075496:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+47:2351:x1874407272254336:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 388us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574329.075505:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00010000:00010000:2.0:1787574329.076279:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfbf8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebbd expref: 46 pid: 5831 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574329.076855:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874407290108416:192.168.206.51@tcp:104: 00010000:00010000:2.0:1787574329.076887:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646bfc14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.076899:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646bfc14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.076925:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646bfc14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574329.076989:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787574329.076995:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787574329.077032:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646bfc14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.077076:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646bfc0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebc4 expref: 46 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.077093:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646bfc14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebc4 expref: 45 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.077102:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:2.0:1787574329.077105:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574329.077625:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069faa00, rc 0) 00000100:00100000:2.0:1787574329.077761:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+45:10403:x1874407272254208:12345-192.168.206.51@tcp:101:bash.0 Request processed in 7825us (8371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574329.077770:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:0.0:1787574329.081972:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574329.084499:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272254592 00000100:00100000:1.0:1787574329.084521:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272254592 00000100:00100000:1.0:1787574329.084606:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:1.0:1787574329.084619:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a03536450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+45:10403:x1874407272254592:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:1.0:1787574329.084939:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a03536450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+46:10403:x1874407272254592:12345-192.168.206.51@tcp:35:bash.0 Request processed in 321us (2990us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1787574329.084950:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:0.0:1787574329.190954:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574329.191144:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272254848 00000100:00100000:2.0:1787574329.191158:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272254848 00000100:00100000:2.0:1787574329.191276:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:2.0:1787574329.191288:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+46:10414:x1874407272254848:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1787574329.191327:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574329.191353:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646bfc1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ebcb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574329.191532:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787574329.191686:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646bfc1b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebcb expref: 48 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.191705:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34300) 00010000:00010000:2.0:1787574329.191709:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787574329.191715:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646bfc1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebcb expref: 48 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.191731:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fae00, rc 0) 00000100:00100000:2.0:1787574329.191812:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+47:10414:x1874407272254848:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 526us (870us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1787574329.191821:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:1.0:1787574329.196106:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574329.196257:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272254976 00000100:00100000:0.0:1787574329.196272:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272254976 00000100:00100000:0.0:1787574329.197154:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:0.0:1787574329.197219:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+47:10414:x1874407272254976:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:0.0:1787574329.197340:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfc29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197359:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfc29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197372:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfc29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197391:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfc30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197398:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfc30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197404:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfc30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197517:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfc37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197526:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfc37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197533:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfc37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574329.197585:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfc37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197600:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfc29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197618:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfc29 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197625:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfc29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197631:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00031200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574329.197636:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfc29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197644:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfc29 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197659:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:0.0:1787574329.197662:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574329.197667:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfc29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197673:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfc29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197690:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfc30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197696:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfc30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197702:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfc30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197707:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574329.197716:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfc30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197723:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfc30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197732:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982a0de1d000) 00010000:00010000:0.0:1787574329.197735:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574329.197738:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfc30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197744:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfc30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197759:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfc37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197765:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfc37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197771:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfc37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197775:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574329.197778:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfc37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197784:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfc37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197792:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:0.0:1787574329.197794:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574329.197806:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfc37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.197811:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfc37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574329.197920:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+47:10414:x1874407272254976:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 753us (1826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574329.197928:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:0.0:1787574329.203969:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574329.204148:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272255232 00000100:00100000:1.0:1787574329.204190:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272255232 00000100:00100000:1.0:1787574329.204265:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1787574329.204278:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+47:10414:x1874407272255232:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1787574329.204600:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+48:10414:x1874407272255232:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 323us (643us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787574329.204608:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1787574329.241278:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574329.241385:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272255488 00000100:00100000:2.0:1787574329.241400:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272255488 00000100:00100000:2.0:1787574329.241487:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:2.0:1787574329.241501:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+48:10417:x1874407272255488:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1787574329.241535:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574329.241562:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646bfc3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ebd2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.241702:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646bfc45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.241719:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646bfc45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.241746:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646bfc45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.241764:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646bfc4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.241771:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646bfc4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.241791:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646bfc4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.241965:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646bfc53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.241975:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646bfc53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.241983:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646bfc53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574329.241995:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787574329.242120:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646bfc45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.242128:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646bfc45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.242136:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646bfc45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.242142:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fbe00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574329.242154:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646bfc45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.242163:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646bfc45 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.242232:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:2.0:1787574329.242235:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574329.242240:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646bfc45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.242247:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646bfc45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.242263:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646bfc4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.242269:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646bfc4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.242275:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646bfc4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.242280:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fb000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574329.242283:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646bfc4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.242290:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646bfc4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.242297:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982a03b34d00) 00010000:00010000:2.0:1787574329.242299:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574329.242311:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646bfc4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.242317:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646bfc4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.242367:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646bfc3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebd2 expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.242382:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646bfc53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebd2 expref: 50 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.242390:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:2.0:1787574329.242392:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574329.242395:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fa600, rc 0) 00000100:00100000:2.0:1787574329.242468:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+50:10417:x1874407272255488:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 970us (1204us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1787574329.242476:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:0.0:1787574329.246981:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574329.247073:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574329.247214:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272255744 00000100:00100000:1.0:1787574329.247228:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272255744 00000100:00100000:1.0:1787574329.247312:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1787574329.247324:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+50:2353:x1874407272255744:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574329.247345:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574329.247376:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646bfc53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebd2 expref: 50 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.247399:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:1.0:1787574329.247405:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574329.247822:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+49:2353:x1874407272255744:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 497us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574329.247832:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:3.0:1787574329.248017:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272255616 00000100:00100000:3.0:1787574329.248023:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272255616 00000100:00100000:3.0:1787574329.248068:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:3.0:1787574329.248076:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+49:10417:x1874407272255616:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:3.0:1787574329.248162:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfc61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.248204:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfc61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.248216:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfc61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.248261:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfc61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.248268:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfc61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.248275:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfc61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.248282:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574329.248286:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfc61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.248294:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfc61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.248305:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:3.0:1787574329.248308:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787574329.248311:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfc61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.248317:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfc61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574329.248365:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+49:10417:x1874407272255616:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 290us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574329.248372:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:0.0:1787574329.251850:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574329.251978:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272256000 00000100:00100000:2.0:1787574329.251990:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272256000 00000100:00100000:2.0:1787574329.252080:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:2.0:1787574329.252092:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41db9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+49:10417:x1874407272256000:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1787574329.252503:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41db9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+50:10417:x1874407272256000:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 411us (661us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787574329.252512:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:2.0:1787574329.362281:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574329.362446:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272256256 00000100:00100000:0.0:1787574329.362461:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272256256 00000100:00100000:0.0:1787574329.362597:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:0.0:1787574329.362611:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+50:10435:x1874407272256256:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:0.0:1787574329.362643:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574329.362670:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfc68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ebd9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.362820:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfc6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.362843:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfc6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.362865:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfc6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574329.362881:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787574329.363070:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfc68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebd9 expref: 53 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.363094:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfc6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebd9 expref: 52 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.363105:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:0.0:1787574329.363117:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787574329.363122:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a00030200, rc 0) 00000100:00100000:0.0:1787574329.363254:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+52:10435:x1874407272256256:12345-192.168.206.51@tcp:101:cat.0 Request processed in 646us (987us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787574329.363262:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:0.0:1787574329.392449:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574329.392535:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272256384 00000100:00100000:3.0:1787574329.392549:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272256384 00000100:00100000:3.0:1787574329.392633:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:3.0:1787574329.392725:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41db8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+52:10436:x1874407272256384:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1787574329.392764:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574329.392854:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfc7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ebe0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.393064:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfc84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.393081:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfc84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.393094:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfc84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574329.393229:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787574329.393234:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787574329.393262:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfc84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.393938:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfc7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebe0 expref: 54 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.393968:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfc84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebe0 expref: 53 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.393979:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:3.0:1787574329.393982:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574329.393986:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16143000, rc 0) 00000100:00100000:3.0:1787574329.395489:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41db8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+53:10436:x1874407272256384:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 2756us (3042us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574329.395529:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:2.0:1787574329.402120:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574329.402215:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272256768 00000100:00100000:1.0:1787574329.402228:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272256768 00000100:00100000:1.0:1787574329.402302:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:1.0:1787574329.402314:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+53:10436:x1874407272256768:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1787574329.402721:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+54:10436:x1874407272256768:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 408us (629us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787574329.402730:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:2.0:1787574329.414024:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574329.414276:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272256896 00000100:00100000:3.0:1787574329.414291:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272256896 00000100:00100000:2.0:1787574329.414550:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1787574329.414565:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+54:10436:x1874407272256896:12345-192.168.206.51@tcp:103:lfs.0 00010000:00010000:2.0:1787574329.414584:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787574329.414615:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646bfc14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebc4 expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.414641:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfc6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebd9 expref: 53 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.414654:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2abc00/0xfe91058e646bfb1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb85 expref: 52 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.414666:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34500) 00010000:00010000:2.0:1787574329.414678:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574329.414755:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+51:10436:x1874407272256896:12345-192.168.206.51@tcp:103:lfs.0 Request processed in 193us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574329.414764:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:0.0:1787574329.425416:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574329.425474:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272257024 00000100:00100000:1.0:1787574329.425489:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272257024 00000100:00100000:1.0:1787574329.425575:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:1.0:1787574329.425588:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41dbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+51:10436:x1874407272257024:12345-192.168.206.51@tcp:58:lfs.0 00010000:00010000:1.0:1787574329.425741:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfc8b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.425763:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfc8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.425779:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfc8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787574329.426101:0:7646:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574329.426716:0:7646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787574329.426798:0:7646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787574329.428845:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41dbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+51:10436:x1874407272257024:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 3244us (3428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574329.428863:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:3.0:1787574329.451317:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574329.451457:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272257152 00000100:00100000:0.0:1787574329.451472:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272257152 00000100:00100000:0.0:1787574329.451558:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:0.0:1787574329.451570:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+51:10438:x1874407272257152:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1787574329.451599:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574329.451626:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfc92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ebe7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.451710:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfc99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.451727:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfc99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.451740:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfc99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.451776:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfca0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.452094:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.452103:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.452277:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfca7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.452287:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfca7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.452294:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfca7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574329.452340:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787574329.452345:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787574329.452369:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfca7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.452383:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfca7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.452392:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfc99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.452399:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfc99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.452419:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfc99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.452425:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030e00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574329.452432:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfc99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.453033:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfc99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.453051:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:0.0:1787574329.453054:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574329.453060:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfc99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.453067:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfc99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.453083:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.453089:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfca0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.453095:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfca0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.453099:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574329.453102:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfca0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.453133:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfca0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.453142:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982a0de1d000) 00010000:00010000:0.0:1787574329.453144:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574329.453147:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfca0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.453154:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfca0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.453248:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfc92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebe7 expref: 53 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.453265:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfca7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebe7 expref: 52 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.453273:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a04da2b00) 00010000:00010000:0.0:1787574329.453276:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787574329.453278:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a00031200, rc 0) 00000100:00100000:0.0:1787574329.453376:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+52:10438:x1874407272257152:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1805us (2070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574329.453387:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 67 00000040:00080000:2.0:1787574329.841425:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787574329.841436:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787574329.841670:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787574329.841679:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787574329.841837:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d70a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874407290108544:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787574329.842010:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff98290619c900 going to sleep for 11 seconds 00000100:00100000:3.0:1787574329.854716:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574329.854810:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272257280 00000100:00100000:0.0:1787574329.854823:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272257280 00000100:00100000:0.0:1787574329.854897:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:0.0:1787574329.854909:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+53:10449:x1874407272257280:12345-192.168.206.51@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787574329.855023:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+53:10449:x1874407272257280:12345-192.168.206.51@tcp:900:lhsmtool_posix.0 Request processed in 116us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574329.855032:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:1.0:1787574329.855036:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d70a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874407290108544:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787574329.866806:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574329.869356:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272257408 00000100:00100000:0.0:1787574329.869379:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272257408 00000100:00100000:0.0:1787574329.869517:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:0.0:1787574329.869530:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+52:10449:x1874407272257408:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787574329.869572:0:5830:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787574329.869721:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+52:10449:x1874407272257408:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 193us (2924us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574329.869730:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:1.0:1787574329.878777:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574329.883361:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272257536 00000100:00100000:3.0:1787574329.883675:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272257536 00000100:00100000:3.0:1787574329.883920:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:3.0:1787574329.883936:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+52:10449:x1874407272257536:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787574329.884045:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfcae lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.884066:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfcae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.884082:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfcae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887055:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfcb5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887081:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfcb5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887094:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfcb5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887147:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfcbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887191:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfcbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887200:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfcbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574329.887249:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787574329.887254:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787574329.887267:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfcbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887279:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfcae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887285:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfcae lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887292:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfcae lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887298:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574329.887302:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfcae lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887309:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfcae lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887322:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982a04da2c00) 00010000:00010000:3.0:1787574329.887325:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574329.887329:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfcae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887344:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfcae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887360:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfcb5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887367:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfcb5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887373:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfcb5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887439:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574329.887443:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfcb5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887450:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfcb5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887458:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff982a04dc0c00) 00010000:00010000:3.0:1787574329.887461:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574329.887463:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfcb5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887469:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfcb5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887486:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfcbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887493:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfcbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887507:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfcbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887512:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16143a00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574329.887516:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfcbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887522:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfcbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887531:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a04da2b00) 00010000:00010000:3.0:1787574329.887534:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574329.887537:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfcbc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.887542:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfcbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574329.887643:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+52:10449:x1874407272257536:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 3707us (8881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574329.887653:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:0.0:1787574329.891725:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574329.891800:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272257792 00000100:00100000:1.0:1787574329.891812:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272257792 00000100:00100000:1.0:1787574329.891891:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:1.0:1787574329.891904:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41db8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+52:10449:x1874407272257792:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787574329.891932:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574329.891961:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bfcc3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ebee expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.892078:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646bfcca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.892095:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646bfcca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.892120:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646bfcca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574329.892135:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787574329.892296:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646bfcca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.892306:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646bfcca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.892315:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646bfcca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.892324:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1e00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574329.892342:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646bfcca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.892353:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646bfcca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.892370:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a04da2b00) 00010000:00010000:1.0:1787574329.892375:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787574329.892381:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646bfcca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.892388:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646bfcca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.892437:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bfcc3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebee expref: 54 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.892448:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982a04da2c00) 00010000:00010000:1.0:1787574329.892451:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787574329.892455:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bfcc3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebee expref: 54 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.892465:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0600, rc 0) 00000100:00100000:1.0:1787574329.892540:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41db8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+53:10449:x1874407272257792:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 639us (825us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1787574329.892548:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:1.0:1787574329.904407:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574329.904487:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272257920 00000100:00100000:0.0:1787574329.904500:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272257920 00000100:00100000:0.0:1787574329.904575:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:0.0:1787574329.904589:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+53:10449:x1874407272257920:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787574329.904662:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787574329.904803:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+53:10449:x1874407272257920:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 217us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574329.904812:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:2.0:1787574329.917328:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574329.920910:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272258176 00000100:00100000:3.0:1787574329.920936:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272258176 00000100:00100000:3.0:1787574329.921061:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:3.0:1787574329.921074:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+53:10449:x1874407272258176:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574329.921114:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574329.921118:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787574329.921160:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfc84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebe0 expref: 53 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.921343:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:3.0:1787574329.921349:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574329.921367:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfcd8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ebf5 expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787574329.921917:0:7646:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787574329.922159:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfcdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.922463:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfcdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.922477:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfcdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.922559:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfcd8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebf5 expref: 55 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.922574:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfcdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebf5 expref: 54 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.922582:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982a04dc0c00) 00010000:00010000:3.0:1787574329.922585:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574329.922588:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142400, rc 0) 00000100:00100000:3.0:1787574329.922673:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+54:10449:x1874407272258176:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1600us (5358us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787574329.922682:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:0.0:1787574329.928653:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574329.928736:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272258432 00000100:00100000:3.0:1787574329.928750:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272258432 00000100:00100000:3.0:1787574329.928855:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:3.0:1787574329.928868:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41db8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+54:10449:x1874407272258432:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787574329.928951:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574329.928991:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfcdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebf5 expref: 54 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.929012:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982a04dc0c00) 00010000:00010000:3.0:1787574329.929027:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574329.929055:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfced lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.929070:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfced lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.929082:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfced lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.929161:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfcf4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa1af0c9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.929199:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfcf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa1af0c9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.929206:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfcf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa1af0c9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.929311:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfced lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.929332:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfced lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.929339:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfced lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.929347:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574329.929352:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfced lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.929360:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfced lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.929370:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:3.0:1787574329.929373:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574329.929378:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfced lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.929384:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bfced lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.929394:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfcf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa1af0c9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.929400:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfcf4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa1af0c9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.929406:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfcf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa1af0c9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.929412:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574329.929421:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfcf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa1af0c9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.929428:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfcf4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa1af0c9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.929436:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa1af0c9b (ffff982a04dc0600) 00010000:00010000:3.0:1787574329.929439:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574329.929442:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfcf4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa1af0c9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.929448:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bfcf4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa1af0c9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574329.929548:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41db8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+53:10449:x1874407272258432:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 682us (907us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787574329.929557:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:3.0:1787574329.931402:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574329.931556:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272258560 00000100:00100000:0.0:1787574329.931569:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272258560 00000100:00100000:0.0:1787574329.931636:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:0.0:1787574329.931648:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+53:10449:x1874407272258560:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574329.931685:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574329.931712:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfcfb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ebfc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.931758:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfd02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.931772:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfd02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.931785:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfd02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.931904:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfcfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebfc expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.931923:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfd02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebfc expref: 54 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574329.931932:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982a0de1d000) 00010000:00010000:0.0:1787574329.931935:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787574329.931940:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a00030e00, rc 0) 00000100:00100000:0.0:1787574329.932019:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+54:10449:x1874407272258560:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 372us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574329.932027:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:3.0:1787574329.937833:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574329.938942:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272258816 00000100:00100000:1.0:1787574329.938959:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272258816 00000100:00100000:1.0:1787574329.939036:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:1.0:1787574329.939137:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+54:10449:x1874407272258816:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787574329.939438:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bfd09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.939461:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bfd09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574329.939478:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bfd09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787574329.939831:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1787574329.939843:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 306114676786ns, next at 307114674075ns, rc = 0 00000004:00010000:1.0:1787574329.939965:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087298e4e reply state 00000000cec9ca5a transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bfd09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574329.939975:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787574329.940698:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+56:10449:x1874407272258816:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 1637us (3009us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1787574329.940709:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 75 00010000:00010000:3.0:1787574329.944570:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bfd09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.944591:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bfd09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.944601:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bfd09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.944608:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574329.944615:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bfd09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.944641:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bfd09 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.944665:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982a0de1d000) 00010000:00010000:3.0:1787574329.944669:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787574329.944674:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bfd09 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574329.944680:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bfd09 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574329.949977:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574329.950288:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272258944 00000100:00100000:2.0:1787574329.950301:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272258944 00000100:00100000:2.0:1787574329.950383:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:2.0:1787574329.950395:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+55:10449:x1874407272258944:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787574329.950430:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574329.950456:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646bfd10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec03 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.950535:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646bfd10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec03 expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.950568:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646bfd10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec03 expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574329.950597:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982a0de1d000) 00010000:00010000:2.0:1787574329.950600:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787574329.950605:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fa600, rc 0) 00000100:00100000:2.0:1787574329.950688:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+56:10449:x1874407272258944:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 296us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574329.950697:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:0.0:1787574329.953962:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574329.954116:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272259072 00000100:00100000:2.0:1787574329.954129:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272259072 00000100:00100000:2.0:1787574329.954208:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:2.0:1787574329.954219:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41dbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1874407272259072:12345-192.168.206.51@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787574329.954261:0:6682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:2.0:1787574329.954299:0:6682:0:(genops.c:1385:class_connect()) connect: client a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f, cookie 0xfe91058e646bfd17 00002000:00100000:2.0:1787574329.954313:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f/ffff982a41244000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787574329.954343:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787574329.954635:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787574329.954674:0:6682:0:(import.c:65:import_set_state_nolock()) ffff982a41247800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574329.955554:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41dbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2349:x1874407272259072:12345-192.168.206.51@tcp:8:lhsmtool_posix.0 Request processed in 550us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574329.955570:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:0.0:1787574329.960010:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574329.960097:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272259200 00000100:00100000:3.0:1787574329.960121:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272259200 00000100:00100000:3.0:1787574329.960218:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:3.0:1787574329.960231:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41db8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:0:x1874407272259200:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787574329.960757:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1787574330.046728:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f 00000001:00080000:2.0:1787574330.046756:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:0.0:1787574330.048814:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41db8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:0:x1874407272259200:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 88572us (88804us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787574330.048839:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:3.0:1787574330.051239:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574330.051458:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272259456 00000100:00100000:0.0:1787574330.051473:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272259456 00000100:00100000:0.0:1787574330.051550:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:0.0:1787574330.051565:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+56:10449:x1874407272259456:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787574330.051882:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+57:10449:x1874407272259456:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 320us (655us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787574330.051891:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:2.0:1787574330.054486:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574330.054651:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272259712 00000100:00100000:3.0:1787574330.054665:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272259712 00000100:00100000:3.0:1787574330.054781:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:3.0:1787574330.054796:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+57:10449:x1874407272259712:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787574330.054945:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+57:10449:x1874407272259712:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 153us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574330.054956:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:2.0:1787574330.059937:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574330.060804:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272259840 00000100:00100000:0.0:1787574330.060822:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272259840 00000100:00100000:0.0:1787574330.060922:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:0.0:1787574330.060935:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+57:10449:x1874407272259840:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574330.060962:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574330.061005:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfd1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec0a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.061134:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfd25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.061151:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfd25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.061187:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfd25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574330.061246:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787574330.061269:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfd25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.061323:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030200/0xfe91058e646bfd1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec0a expref: 59 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.061342:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfd25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec0a expref: 58 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.061352:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982a0de1d000) 00010000:00010000:0.0:1787574330.061356:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787574330.061360:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a00030400, rc 0) 00000100:00100000:0.0:1787574330.061453:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+58:10449:x1874407272259840:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 521us (1532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574330.061461:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:2.0:1787574330.067782:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574330.073832:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272259968 00000100:00100000:1.0:1787574330.073853:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272259968 00000100:00100000:1.0:1787574330.073935:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:1.0:1787574330.073948:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2350:x1874407272259968:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787574330.073975:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574330.074002:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c3fa431/0xfe91058e646bfd2c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec11 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787574330.074039:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c3839, blocks: 0x1 00010000:00010000:1.0:1787574330.074065:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=306s v=(0 0) 00010000:00010000:1.0:1787574330.074076:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574330.074088:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c3fa431/0xfe91058e646bfd2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec11 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.074123:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c3fa431/0xfe91058e646bfd2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec11 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.074142:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0800, rc 0) 00000100:00100000:1.0:1787574330.074250:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2350:x1874407272259968:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 304us (6492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574330.074258:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:3.0:1787574330.082874:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574330.083289:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272260224 00000100:00100000:0.0:1787574330.083303:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272260224 00000100:00100000:0.0:1787574330.083370:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:0.0:1787574330.083382:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+58:10449:x1874407272260224:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787574330.083530:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+58:10449:x1874407272260224:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 150us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574330.083539:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:1.0:1787574330.085802:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574330.085918:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272260352 00000100:00100000:3.0:1787574330.085930:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272260352 00000100:00100000:3.0:1787574330.086007:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:3.0:1787574330.086018:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:10449:x1874407272260352:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574330.086038:0:8472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574330.086060:0:8472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000485b79f5/0xfe91058e646bfd33 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec18 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.086096:0:8472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c3fa431/0xfe91058e646bfd2c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec11 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.086115:0:8472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574330.086120:0:8472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574330.086125:0:8472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000485b79f5/0xfe91058e646bfd33 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec18 expref: 7 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.086199:0:8472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c3fa431/0xfe91058e646bfd2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec11 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.086215:0:8472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c3fa431/0xfe91058e646bfd2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec11 expref: 7 pid: 6681 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574330.086232:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3ad36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8472:1874407290108672:192.168.206.51@tcp:104: 00000100:00100000:3.0:1787574330.086423:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0828c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574330.088204:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3ad36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8472:1874407290108672:192.168.206.51@tcp:104: 00010000:00010000:3.0:1787574330.088250:0:8472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000485b79f5/0xfe91058e646bfd33 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec18 expref: 7 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.088294:0:8472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142000, rc 0) 00000100:00100000:3.0:1787574330.088363:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:10449:x1874407272260352:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 2346us (2571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574330.088373:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:3.0:1787574330.093070:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:3.0:1787574330.098274:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574330.100718:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272260480 00000100:00100000:0.0:1787574330.100743:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272260480 00010000:00010000:1.0:1787574330.109367:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c3fa431/0xfe91058e646bfd2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec11 expref: 7 pid: 6681 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574330.109440:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:1.0:1787574330.109454:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a063aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2351:x1874407272260480:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574330.109472:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574330.109502:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c3fa431/0xfe91058e646bfd2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec11 expref: 7 pid: 6681 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.109519:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c3fa431/0xfe91058e646bfd2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec11 expref: 7 pid: 6681 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.109546:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c3fa431/0xfe91058e646bfd2c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec11 expref: 7 pid: 6681 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.109596:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574330.109601:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574330.109611:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000485b79f5/0xfe91058e646bfd33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec18 expref: 6 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.109623:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000485b79f5/0xfe91058e646bfd33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec18 expref: 6 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.109675:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000485b79f5/0xfe91058e646bfd33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec18 expref: 6 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574330.109692:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5816:1874407290108800:192.168.206.51@tcp:105: 00000100:00100000:1.0:1787574330.109982:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff982906a61f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787574330.127922:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574330.128465:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272260608 00000100:00100000:0.0:1787574330.128478:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272260608 00002000:00100000:0.0:1787574330.128541:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff982a2ff02d80 x1874407272260608/t0(0) o4->a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp:101/0 lens 504/0 e 0 to 0 dl 1787574341 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787574330.128554:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a2ff02d80 with x1874407272260608 ext(0->8) 00002000:00010000:0.0:1787574330.128577:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff982a2ff02d80 00000100:00100000:0.0:1787574330.128625:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:0.0:1787574330.128636:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2351:x1874407272260608:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787574330.129248:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5816:1874407290108800:192.168.206.51@tcp:105: 00010000:00010000:2.0:1787574330.129282:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574330.129361:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a063aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2351:x1874407272260480:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 19909us (36303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574330.129372:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:0.0:1787574330.129935:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2351:x1874407272260608:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 1293us (2021us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787574330.129948:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00002000:00100000:0.0:1787574330.129959:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff982a2ff02d80 x1874407272260608/t4294967302(0) o4->a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp:101/0 lens 504/448 e 0 to 0 dl 1787574341 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787574330.129970:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a2ff02d80 with x1874407272260608 ext(0->8) 00002000:00010000:0.0:1787574330.129976:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff982a2ff02d80 00000100:00100000:1.0:1787574330.133803:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574330.133912:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272260736 00000100:00100000:3.0:1787574330.133927:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272260736 00000100:00100000:3.0:1787574330.133997:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:3.0:1787574330.134011:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2ff03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+58:10449:x1874407272260736:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787574330.209144:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2ff03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+58:10449:x1874407272260736:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 75121us (75339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574330.209159:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00000001:00080000:3.0:1787574330.209456:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1787574330.209490:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:3.0:1787574330.209551:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1787574330.209570:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff982a04915a80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787574330.209574:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982a1696eb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff982a04915600 00000020:00080000:3.0:1787574330.209577:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982a1696e000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff982a41d96000 00000020:00080000:3.0:1787574330.209880:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1787574330.210010:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1787574330.210034:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3ad36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290108928:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787574330.210142:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574330.211611:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3ad35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290109056:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787574330.211684:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574330.211804:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290108928 00000100:00100000:1.0:1787574330.211820:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290108928 00000100:00100000:3.0:1787574330.211969:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290109056 00000100:00100000:3.0:1787574330.211988:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290109056 00000100:00100000:1.0:1787574330.212136:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787574330.212148:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290108928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787574330.212203:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787574330.212213:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41dbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1874407290109056:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787574330.212379:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1787574330.212399:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787574330.212404:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787574330 00002000:00010000:1.0:1787574330.212407:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787574330.212409:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787574329 -> 1787574330 00002000:00010000:1.0:1787574330.212412:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:3.0:1787574330.212424:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8c3837, atime: 0x6a8c3837, ctime: 0x6a8c3837, blocks: 0x1 00010000:00010000:3.0:1787574330.212435:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003763ada1/0xfe91058e646bfd3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.212456:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=306s v=(0 0) 00010000:00010000:3.0:1787574330.212462:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574330.212471:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003763ada1/0xfe91058e646bfd3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574330.212476:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1874407290108928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 328us (2332us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787574330.212492:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1787574330.212495:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003763ada1/0xfe91058e646bfd3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.212510:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003763ada1/0xfe91058e646bfd3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.212519:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003763ada1/0xfe91058e646bfd3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.212540:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787574330.212567:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574330.212645:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003763ada1/0xfe91058e646bfd3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.212656:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142200 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574330.212662:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003763ada1/0xfe91058e646bfd3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.212672:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003763ada1/0xfe91058e646bfd3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.212695:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003763ada1/0xfe91058e646bfd3a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.212703:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003763ada1/0xfe91058e646bfd3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.212727:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574330.212729:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574330.212731:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787574330.213217:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574330.213223:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574330.213464:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41dbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3298:x1874407290109056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1251us (1778us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787574330.213474:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1787574330.213545:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982a3ad35f80/2, rc 0, transno 4294967301 00000100:00100000:3.0:1787574330.213560:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3ad35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290109056:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1787574330.213594:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982a3ad36680/2, rc 0, transno 4294967303 00000100:00100000:3.0:1787574330.213599:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3ad36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290108928:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787574330.217654:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574330.217721:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272260864 00000100:00100000:3.0:1787574330.217735:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272260864 00000100:00100000:3.0:1787574330.217811:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:3.0:1787574330.217825:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2350:x1874407272260864:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787574330.284112:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1787574330.284160:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1787574330.284488:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2350:x1874407272260864:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 66658us (66839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574330.284500:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:2.0:1787574330.294150:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574330.294398:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272261120 00000100:00100000:0.0:1787574330.294411:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272261120 00000100:00100000:0.0:1787574330.294487:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:0.0:1787574330.294500:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+13:10449:x1874407272261120:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787574330.294575:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574330.294614:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030400/0xfe91058e646bfd25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec0a expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.294635:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982a0de1d000) 00010000:00010000:0.0:1787574330.294655:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574330.294698:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646bfd41 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.294716:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646bfd41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.294728:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646bfd41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574330.295347:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da3c439c reply state 00000000f4a29f4f transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646bfd41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574330.295362:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574330.295505:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+14:10449:x1874407272261120:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 1006us (1368us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787574330.295514:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:3.0:1787574330.301643:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574330.301888:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272261248 00000100:00100000:2.0:1787574330.301904:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272261248 00000100:00100000:2.0:1787574330.301977:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:2.0:1787574330.301990:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2351:x1874407272261248:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787574330.302368:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787574330.302373:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787574330 -> 1787574329 00002000:00010000:2.0:1787574330.302375:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787574327 00002000:00010000:2.0:1787574330.302388:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787574330 -> 1787574329 00002000:00010000:2.0:1787574330.302391:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787574330.302466:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2351:x1874407272261248:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 477us (836us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787574330.302476:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00010000:00010000:1.0:1787574330.302958:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646bfd41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.302971:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646bfd41 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.302981:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646bfd41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.302997:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01e00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574330.303004:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646bfd41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.303013:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646bfd41 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.303037:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982a0de1d000) 00010000:00010000:1.0:1787574330.303041:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574330.303046:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646bfd41 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.303054:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646bfd41 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574330.306649:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574330.308911:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272261504 00000100:00100000:2.0:1787574330.308935:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272261504 00000100:00100000:2.0:1787574330.309021:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:2.0:1787574330.309034:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+13:10449:x1874407272261504:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787574330.309136:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646bfd48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.309160:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfd02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebfc expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.309196:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646bfd48 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.309244:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfd02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebfc expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.309262:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfd02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebfc expref: 13 pid: 5830 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574330.309279:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d71180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874407290109184:192.168.206.51@tcp:104: 00000100:00100000:2.0:1787574330.309398:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3a6c3900 going to sleep for 11 seconds 00000100:00100000:0.0:1787574330.312910:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d71180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874407290109184:192.168.206.51@tcp:104: 00010000:00010000:0.0:1787574330.312966:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646bfd48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574330.313303:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574330.313624:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272261632 00000100:00100000:2.0:1787574330.313636:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272261632 00010000:00010000:2.0:1787574330.313702:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfd02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebfc expref: 14 pid: 5830 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574330.313747:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:2.0:1787574330.313757:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+14:2350:x1874407272261632:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574330.313782:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574330.313790:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfd02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebfc expref: 14 pid: 5830 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.313804:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfd02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebfc expref: 14 pid: 5830 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.313829:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00030e00/0xfe91058e646bfd02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebfc expref: 14 pid: 5830 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.313848:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982a0de1d000) 00010000:00010000:2.0:1787574330.313854:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646bfd48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.313864:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646bfd48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.313874:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646bfd48 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.313905:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574330.313984:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+13:2350:x1874407272261632:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 227us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574330.313992:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 43 00010000:00010000:3.0:1787574330.314387:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646bfd48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.314398:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646bfd48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.314440:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646bfd48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.314448:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646bfd48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.314456:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646bfd48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.314463:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fb400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574330.314469:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646bfd48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.314491:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646bfd48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.314504:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982a0de1d000) 00010000:00010000:3.0:1787574330.314507:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787574330.314512:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646bfd48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.314518:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646bfd48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574330.314577:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+12:10449:x1874407272261504:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 5545us (7940us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787574330.314586:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:3.0:1787574330.318816:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574330.320513:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272261760 00000100:00100000:2.0:1787574330.320537:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272261760 00000100:00100000:2.0:1787574330.320691:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:2.0:1787574330.320706:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2351:x1874407272261760:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787574330.320774:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646bfd4f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.320804:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000485b79f5/0xfe91058e646bfd33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec18 expref: 7 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.320814:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574330.320819:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574330.320826:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646bfd4f lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.320873:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000485b79f5/0xfe91058e646bfd33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec18 expref: 7 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.320888:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000485b79f5/0xfe91058e646bfd33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec18 expref: 7 pid: 8472 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574330.320904:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6683:1874407290109312:192.168.206.51@tcp:104: 00000100:00100000:2.0:1787574330.321025:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3a6c3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574330.323733:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6683:1874407290109312:192.168.206.51@tcp:104: 00010000:00010000:0.0:1787574330.323775:0:6683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646bfd4f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574330.324055:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574330.324909:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272261888 00000100:00100000:1.0:1787574330.324923:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272261888 00010000:00010000:1.0:1787574330.324987:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000485b79f5/0xfe91058e646bfd33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec18 expref: 8 pid: 8472 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574330.325046:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:1.0:1787574330.325059:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2350:x1874407272261888:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574330.325078:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574330.325123:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000485b79f5/0xfe91058e646bfd33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec18 expref: 8 pid: 8472 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.325139:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000485b79f5/0xfe91058e646bfd33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec18 expref: 8 pid: 8472 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.325203:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000485b79f5/0xfe91058e646bfd33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec18 expref: 8 pid: 8472 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.325222:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787574330.325227:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787574330.325235:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646bfd4f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.325245:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646bfd4f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.325277:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574330.325643:0:6683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646bfd4f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.325656:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646bfd4f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.325695:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646bfd4f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.325704:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646bfd4f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.325712:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646bfd4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.325720:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fba00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574330.325725:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646bfd4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.325734:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646bfd4f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.325751:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646bfd4f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.325760:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646bfd4f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574330.325879:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2351:x1874407272261760:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 5175us (7077us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574330.325891:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:1.0:1787574330.332626:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2350:x1874407272261888:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 7550us (8555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574330.332645:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:3.0:1787574330.335242:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574330.335328:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272262144 00000100:00100000:0.0:1787574330.335344:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272262144 00000100:00100000:0.0:1787574330.335424:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:0.0:1787574330.335439:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+12:10449:x1874407272262144:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787574330.335539:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646bfd56 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.335568:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646bfd56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.335583:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646bfd56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.338127:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bfd5d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.338160:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646bfd10 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec03 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.338211:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bfd5d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.338269:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646bfd10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec03 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.338288:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646bfd10 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec03 expref: 13 pid: 5830 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574330.338308:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41dbbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874407290109440:192.168.206.51@tcp:104: 00000100:00100000:0.0:1787574330.338432:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b6600 going to sleep for 11 seconds 00000100:00100000:3.0:1787574330.340745:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574330.341207:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272262272 00000100:00100000:1.0:1787574330.341219:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272262272 00000100:00100000:0.0:1787574330.341234:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41dbbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874407290109440:192.168.206.51@tcp:104: 00010000:00010000:0.0:1787574330.341273:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bfd5d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.341277:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646bfd10 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec03 expref: 14 pid: 5830 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574330.341329:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:1.0:1787574330.341340:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+14:2351:x1874407272262272:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574330.341358:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574330.341366:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646bfd10 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec03 expref: 14 pid: 5830 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.341401:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646bfd10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec03 expref: 14 pid: 5830 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.341430:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646bfd10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec03 expref: 14 pid: 5830 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.341554:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982a0de1d000) 00010000:00010000:1.0:1787574330.341560:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bfd5d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.341572:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bfd5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.341651:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bfd5d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.341687:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574330.341763:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+13:2351:x1874407272262272:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 423us (1025us total) trans 0 rc 0/0 00010000:00010000:0.0:1787574330.342008:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bfd5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.342019:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bfd5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787574330.342742:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000100:00100000:1.0:1787574330.342936:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 45 00000001:00080000:0.0:1787574330.342953:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1787574330.343009:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1787574330.343154:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41dbbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1874407290109568:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787574330.343260:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574330.344622:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290109568 00000100:00100000:3.0:1787574330.344638:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290109568 00000100:00100000:3.0:1787574330.344710:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787574330.345358:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574330.347050:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41dba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5832:x1874407290109568:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787574330.347262:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41dba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5832:x1874407290109568:12345-0@lo:1000:mdt00_002.0 Request processed in 2540us (4001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574330.347273:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787574330.347458:0:5832:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1787574330.347467:0:5832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982a3ad36680, transno 4294967303 00000100:00100000:1.0:1787574330.347481:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41dbbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1874407290109568:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787574330.349114:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1787574330.349269:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11bb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1874407290109696:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787574330.349475:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574330.349515:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0811b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574330.351688:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290109696 00000100:00100000:3.0:1787574330.351707:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290109696 00000100:00100000:3.0:1787574330.351791:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787574330.351813:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1874407290109696:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787574330.352288:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1874407290109696:12345-0@lo:1000:mdt00_002.0 Request processed in 476us (2810us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787574330.352297:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787574330.352362:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11bb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1874407290109696:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1787574330.352419:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bfd5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.352432:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bfd5d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.352441:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bfd5d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.352448:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574330.352454:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bfd5d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.352463:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bfd5d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.352487:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982a0de1d000) 00010000:00010000:3.0:1787574330.352490:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574330.352496:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bfd5d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.352502:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bfd5d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.352549:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfc8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.354682:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfc8b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.354692:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfc8b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.354699:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574330.354704:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfc8b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.354714:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfc8b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.354734:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a04da2b00) 00010000:00010000:3.0:1787574330.354737:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574330.354743:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfc8b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.354750:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfc8b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.354783:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfd64 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.354800:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfca7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebe7 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.354809:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfd64 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.354860:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfca7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebe7 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.354884:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfca7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebe7 expref: 16 pid: 5832 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574330.354901:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a418a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874407290109824:192.168.206.51@tcp:104: 00000100:00100000:3.0:1787574330.355021:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0828c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574330.360951:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574330.361668:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272262400 00000100:00100000:2.0:1787574330.361681:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272262400 00010000:00010000:2.0:1787574330.361740:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfca7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebe7 expref: 17 pid: 5832 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574330.361804:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:2.0:1787574330.361817:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41db8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+17:2350:x1874407272262400:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574330.361840:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574330.361849:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfca7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebe7 expref: 17 pid: 5832 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.361865:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfca7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebe7 expref: 17 pid: 5832 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.361892:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a04da2b00) 00010000:00010000:2.0:1787574330.361898:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfd64 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.361911:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfd64 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.361918:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031200/0xfe91058e646bfca7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ebe7 expref: 17 pid: 5832 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.361921:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfd64 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574330.361950:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a418a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874407290109824:192.168.206.51@tcp:104: 00010000:00010000:2.0:1787574330.361955:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787574330.361977:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfd64 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.361990:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfd64 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.361997:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfd64 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.362011:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfd64 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.362019:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfd64 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574330.362026:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41db8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+16:2350:x1874407272262400:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 209us (1088us total) trans 0 rc 0/0 00010000:00010000:1.0:1787574330.362031:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfd64 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574330.362039:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 46 00010000:00010000:1.0:1787574330.362042:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574330.362049:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfd64 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.362057:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfd64 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.362068:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a04da2b00) 00010000:00010000:1.0:1787574330.362071:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574330.362082:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfd64 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.362089:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bfd64 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.362117:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646bfd56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.362124:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646bfd56 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.362130:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646bfd56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.362136:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574330.362139:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646bfd56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.362146:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646bfd56 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.362154:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a04da2b00) 00010000:00010000:1.0:1787574330.362157:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787574330.362160:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646bfd56 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.362184:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646bfd56 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574330.362417:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+15:10449:x1874407272262144:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 26981us (27187us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1787574330.362427:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 83 00000020:00080000:1.0:1787574330.362448:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787574330.362865:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787574330.362872:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787574330.362907:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787574330.362917:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787574330.368390:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574330.370205:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272262656 00000100:00100000:0.0:1787574330.370227:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272262656 00000100:00100000:0.0:1787574330.370315:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:0.0:1787574330.370328:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+15:10449:x1874407272262656:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787574330.372554:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787574330.372680:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1787574330.372770:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00200/0xfe91058e646bfd6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.372791:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00200/0xfe91058e646bfd6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.372805:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00200/0xfe91058e646bfd6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.372822:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00200/0xfe91058e646bfd6b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.372829:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00200/0xfe91058e646bfd6b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.372835:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00200/0xfe91058e646bfd6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.372874:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787574330.373020:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+17:10449:x1874407272262656:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 2689us (4638us total) trans 4294967362 rc 0/0 00010000:00010000:2.0:1787574330.373249:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574330.373259:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00200/0xfe91058e646bfd6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.373268:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00200 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574330.373280:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00200/0xfe91058e646bfd6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.373290:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00200/0xfe91058e646bfd6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.373305:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982a0de1d500) 00010000:00010000:2.0:1787574330.373309:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787574330.373314:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00200/0xfe91058e646bfd6b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.373320:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00200/0xfe91058e646bfd6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.373340:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574330.373343:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574330.373345:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574330.374973:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000020:00080000:0.0:1787574330.374989:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:3.0:1787574330.413069:0:12005:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787574330.413079:0:12005:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787574330.413375:0:12005:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787574330.413384:0:12005:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787574330.481745:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41db9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874407290110080:0@lo:400:kworker.0 00000100:00100000:0.0:1787574330.481855:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574330.481932:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574330.481940:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41dbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290110208:0@lo:400:kworker.0 00000100:00100000:0.0:1787574330.481967:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574330.483337:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41db9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290109952:0@lo:400:kworker.0 00000100:00100000:3.0:1787574330.483427:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574330.483602:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41db9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290110336:0@lo:400:kworker.0 00000100:00100000:1.0:1787574330.483647:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574330.483689:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290110080 00000100:00100000:0.0:1787574330.483700:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290109952 00000100:00100000:3.0:1787574330.483701:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290110080 00000100:00100000:0.0:1787574330.483708:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290109952 00000100:00100000:1.0:1787574330.483764:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290110208 00000100:00100000:1.0:1787574330.483769:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290110208 00000100:00100000:0.0:1787574330.483773:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787574330.483784:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04966450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:3299:x1874407290109952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574330.483812:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290110336 00000100:00100000:1.0:1787574330.483816:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290110336 00000100:00100000:3.0:1787574330.483830:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787574330.483842:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41db9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290110208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574330.483848:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787574330.483858:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41dbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874407290110080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574330.483947:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04966450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:3299:x1874407290109952:12345-0@lo:400:kworker.0 Request processed in 164us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574330.483954:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787574330.484023:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41db9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290110208:12345-0@lo:400:kworker.0 Request processed in 184us (2053us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574330.484026:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41dbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874407290110080:12345-0@lo:400:kworker.0 Request processed in 168us (2170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574330.484039:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787574330.484046:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787574330.484064:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787574330.484073:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290110336:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787574330.484079:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574330.484142:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290110336:12345-0@lo:400:kworker.0 Request processed in 71us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574330.484149:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787574330.485531:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41db9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290110336:0@lo:400:kworker.0 00000100:00100000:1.0:1787574330.487668:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41db9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290109952:0@lo:400:kworker.0 00000100:00100000:2.0:1787574330.493317:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41dbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290110208:0@lo:400:kworker.0 00000100:00100000:2.0:1787574330.493340:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41db9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874407290110080:0@lo:400:kworker.0 00000100:00100000:0.0:1787574330.514556:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574330.514686:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272262912 00000100:00100000:1.0:1787574330.514704:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272262912 00000100:00100000:1.0:1787574330.514788:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:1.0:1787574330.514799:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41db9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+17:10459:x1874407272262912:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1787574330.514829:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574330.514853:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646bfd72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec1f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.516470:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1400/0xfe91058e646bfd79 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.516503:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1400/0xfe91058e646bfd79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.516516:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1400/0xfe91058e646bfd79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574330.516533:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787574330.516813:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646bfd72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec1f expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.516834:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1400/0xfe91058e646bfd79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec1f expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.516844:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:1.0:1787574330.516848:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787574330.516851:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1400, rc 0) 00000100:00100000:1.0:1787574330.518665:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41db9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:10459:x1874407272262912:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 2140us (2398us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1787574330.518690:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:3.0:1787574330.521409:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574330.521895:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272263040 00000100:00100000:1.0:1787574330.521909:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272263040 00000100:00100000:1.0:1787574330.521991:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:1.0:1787574330.522001:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:10459:x1874407272263040:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:1.0:1787574330.522096:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfd87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.522123:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfd87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.522155:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfd87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.522206:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfd8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.522215:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfd8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.522222:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfd8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.523809:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646bfd95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.523823:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646bfd95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.523832:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646bfd95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787574330.523875:0:7646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646bfd95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.523887:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfd87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.523893:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfd87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.523899:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfd87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.523918:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574330.523921:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfd87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.523928:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfd87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.523954:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:1.0:1787574330.523958:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574330.523962:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfd87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.523968:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646bfd87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.523982:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfd8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.523988:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfd8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.523994:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfd8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.523999:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574330.524003:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfd8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.524009:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfd8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.524033:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982a04da2b00) 00010000:00010000:1.0:1787574330.524036:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574330.524039:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfd8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.524045:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646bfd8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.524077:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646bfd95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.524083:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646bfd95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.524090:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646bfd95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.524095:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574330.524099:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646bfd95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.524114:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646bfd95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.524122:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a04da2900) 00010000:00010000:1.0:1787574330.524125:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574330.524128:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646bfd95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.524133:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646bfd95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574330.525731:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:10459:x1874407272263040:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 3720us (4324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574330.525746:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:0.0:1787574330.581849:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574330.584262:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272263296 00000100:00100000:2.0:1787574330.584281:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272263296 00000100:00100000:2.0:1787574330.584423:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:2.0:1787574330.584436:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41dba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:10462:x1874407272263296:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1787574330.584463:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574330.584488:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646bfd9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec26 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.584599:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646bfda3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.584633:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646bfda3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.584645:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646bfda3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.584663:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646bfdaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.584671:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646bfdaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.584678:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646bfdaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.585065:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646bfdb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.585075:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646bfdb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.585084:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646bfdb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574330.585094:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787574330.585249:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646bfda3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.585258:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646bfda3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.585265:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646bfda3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.585278:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fb600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574330.585283:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646bfda3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.585291:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646bfda3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.585305:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:2.0:1787574330.585307:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574330.585312:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646bfda3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.585319:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646bfda3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.585331:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646bfdaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.585337:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646bfdaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.585343:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646bfdaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.585348:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fbc00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574330.585350:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646bfdaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.585356:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646bfdaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.585374:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982a03b34500) 00010000:00010000:2.0:1787574330.585376:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574330.585379:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646bfdaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.585385:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646bfdaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.585436:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646bfd9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec26 expref: 22 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.585451:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646bfdb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec26 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.589255:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34d00) 00010000:00010000:2.0:1787574330.589260:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574330.589265:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fb200, rc 0) 00000100:00100000:2.0:1787574330.589361:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41dba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+21:10462:x1874407272263296:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 4921us (7590us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1787574330.589372:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:0.0:1787574330.603334:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574330.603520:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272263424 00000100:00100000:0.0:1787574330.603532:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272263424 00000100:00100000:0.0:1787574330.603609:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:0.0:1787574330.603622:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41db9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+21:10462:x1874407272263424:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:0.0:1787574330.604250:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfdbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.604272:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfdbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.604286:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfdbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.604325:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfdbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.604333:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfdbf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.604340:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfdbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.604348:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574330.604353:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfdbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.604362:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfdbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.604389:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34d00) 00010000:00010000:0.0:1787574330.604393:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787574330.604399:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfdbf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.604406:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfdbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574330.604513:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41db9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+21:10462:x1874407272263424:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 890us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574330.604521:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:2.0:1787574330.619756:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574330.620386:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272263680 00000100:00100000:1.0:1787574330.620399:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272263680 00000100:00100000:1.0:1787574330.620747:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:1.0:1787574330.620759:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a03535050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+21:10462:x1874407272263680:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1787574330.621161:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a03535050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+22:10462:x1874407272263680:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 403us (1419us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787574330.621189:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:0.0:1787574330.698222:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574330.701638:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272263936 00000100:00100000:3.0:1787574330.701687:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272263936 00000100:00100000:3.0:1787574330.701794:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:3.0:1787574330.701809:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41dbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+22:9991:x1874407272263936:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1787574330.701847:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574330.701880:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfdc6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec2d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.702026:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfdcd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.702043:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646bfdb1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec26 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.702055:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfdcd lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.702110:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646bfdb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec26 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.702126:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646bfdb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec26 expref: 23 pid: 5832 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574330.702143:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a418a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874407290110464:192.168.206.51@tcp:104: 00000100:00100000:3.0:1787574330.702319:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0828c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574330.705581:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a418a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874407290110464:192.168.206.51@tcp:104: 00010000:00010000:0.0:1787574330.705621:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfdcd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574330.705819:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574330.705902:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272264064 00000100:00100000:0.0:1787574330.705913:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272264064 00010000:00010000:0.0:1787574330.705964:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646bfdb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec26 expref: 24 pid: 5832 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574330.706009:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:0.0:1787574330.706021:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+24:2351:x1874407272264064:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574330.706040:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574330.706048:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646bfdb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec26 expref: 24 pid: 5832 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.706083:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646bfdb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec26 expref: 24 pid: 5832 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.706121:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646bfdb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec26 expref: 24 pid: 5832 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.706149:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34d00) 00010000:00010000:0.0:1787574330.706156:0:8453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfdcd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.706193:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfdcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.706203:0:8453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfdcd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.706230:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574330.706299:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+23:2351:x1874407272264064:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 280us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574330.706308:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00010000:00010000:3.0:1787574330.706898:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfdcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.706909:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfdcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574330.706945:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787574330.707150:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfdc6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec2d expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.707208:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfdcd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec2d expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.707218:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34d00) 00010000:00010000:3.0:1787574330.707221:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787574330.707224:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16143a00, rc 0) 00000100:00100000:3.0:1787574330.707282:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41dbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+23:9991:x1874407272263936:12345-192.168.206.51@tcp:101:bash.0 Request processed in 5477us (9075us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787574330.707291:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:3.0:1787574330.712892:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574330.712975:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272264320 00000100:00100000:0.0:1787574330.712988:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272264320 00000100:00100000:0.0:1787574330.713066:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:0.0:1787574330.713079:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+23:9991:x1874407272264320:12345-192.168.206.51@tcp:36:bash.0 00010000:00010000:0.0:1787574330.713471:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfddb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.713493:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfddb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.713525:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfddb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787574330.713590:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1787574330.713618:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096097880 reply state 00000000c6814cc2 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfddb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574330.713629:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787574330.713682:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1787574330.713799:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+27:9991:x1874407272264320:12345-192.168.206.51@tcp:36:bash.0 Request processed in 722us (918us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1787574330.713808:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 89 00000020:00080000:0.0:1787574330.713814:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787574330.717011:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfddb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.717033:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfddb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.717042:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfddb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.717048:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574330.717054:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfddb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.717062:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfddb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.717111:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34d00) 00010000:00010000:3.0:1787574330.717115:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574330.717120:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfddb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.717127:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfddb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574330.718109:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574330.718231:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272264448 00000100:00100000:2.0:1787574330.718244:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272264448 00000100:00100000:2.0:1787574330.718315:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:2.0:1787574330.718328:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+26:9991:x1874407272264448:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1787574330.718708:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574330.718735:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa800/0xfe91058e646bfde2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec34 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.718834:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa800/0xfe91058e646bfde2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec34 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.718851:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa800/0xfe91058e646bfde2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec34 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.718876:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34d00) 00010000:00010000:2.0:1787574330.718879:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787574330.718883:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fa800, rc 0) 00000100:00100000:2.0:1787574330.719004:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+27:9991:x1874407272264448:12345-192.168.206.51@tcp:101:bash.0 Request processed in 677us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574330.719012:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:3.0:1787574330.734633:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574330.734730:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272264576 00000100:00100000:2.0:1787574330.734743:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272264576 00000100:00100000:2.0:1787574330.734815:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:2.0:1787574330.734829:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:9991:x1874407272264576:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1787574330.734851:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574330.734880:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5451310/0xfe91058e646bfde9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec3b expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787574330.734914:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8c3839, atime: 0x6a8c3837, ctime: 0x6a8c3839, blocks: 0xb 00010000:00010000:2.0:1787574330.734941:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=306s v=(0 0) 00010000:00010000:2.0:1787574330.734947:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574330.734956:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5451310/0xfe91058e646bfde9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec3b expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.734999:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d5451310/0xfe91058e646bfde9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec3b expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574330.735016:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fb800, rc 0) 00000100:00100000:2.0:1787574330.735151:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:9991:x1874407272264576:12345-192.168.206.51@tcp:101:bash.0 Request processed in 324us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574330.735159:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:1.0:1787574330.752704:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574330.753022:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272264704 00000100:00100000:2.0:1787574330.753036:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272264704 00002000:00010000:2.0:1787574330.753098:0:6687:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787574330.753120:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a11bb5c00 with x1874407272264704 ext(0->18446744073709551615) 00002000:00010000:2.0:1787574330.753137:0:6687:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff982a11bb5c00. 00000100:00100000:2.0:1787574330.753302:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:2.0:1787574330.753325:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2350:x1874407272264704:12345-192.168.206.51@tcp:10:bash.0 00002000:00010000:2.0:1787574330.753682:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787574330.753686:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787574329 -> 1787574330 00002000:00010000:2.0:1787574330.753689:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787574327 -> 1787574327 00002000:00010000:2.0:1787574330.753691:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787574329 -> 1787574330 00002000:00010000:2.0:1787574330.753694:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787574330.753966:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2350:x1874407272264704:12345-192.168.206.51@tcp:10:bash.0 Request processed in 651us (1276us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787574330.753977:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00002000:00010000:2.0:1787574330.753982:0:6687:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787574330.753986:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a11bb5c00 with x1874407272264704 ext(0->18446744073709551615) 00002000:00010000:2.0:1787574330.754008:0:6687:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff982a11bb5c00. 00000100:00100000:0.0:1787574330.837432:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574330.837655:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272264832 00000100:00100000:3.0:1787574330.837668:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272264832 00000100:00100000:3.0:1787574330.838038:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:3.0:1787574330.838053:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41db9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+27:10476:x1874407272264832:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:3.0:1787574330.838213:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfdf0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.838235:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfdf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.838252:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfdf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.838270:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bfdf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.838278:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bfdf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.838286:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bfdf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.838671:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfdfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.838682:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfdfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.838688:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfdfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787574330.838746:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfdfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.838758:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfdf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.838877:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfdf0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.838887:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfdf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.838894:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16143000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574330.838899:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfdf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.838907:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfdf0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.838921:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:3.0:1787574330.838924:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574330.838928:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfdf0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.838942:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfdf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.838956:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bfdf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.838962:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bfdf7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.838968:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bfdf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.838973:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16143800 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574330.838976:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bfdf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.838982:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bfdf7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.838991:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982a04dc0f00) 00010000:00010000:3.0:1787574330.838993:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574330.838996:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bfdf7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.839002:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bfdf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.839019:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfdfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.839025:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfdfe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.839037:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfdfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.839042:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574330.839045:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfdfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.839051:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfdfe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.839060:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34d00) 00010000:00010000:3.0:1787574330.839063:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574330.839065:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfdfe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574330.839071:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfdfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574330.839246:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41db9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+27:10476:x1874407272264832:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 1193us (1825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574330.839255:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:3.0:1787574330.899532:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574330.900119:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272265088 00000100:00100000:0.0:1787574330.900142:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272265088 00000100:00100000:0.0:1787574330.900268:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:0.0:1787574330.900282:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+27:10479:x1874407272265088:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1787574330.900309:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574330.900338:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646bfe05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec42 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.900438:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646bfe0c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.900456:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646bfe0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.900472:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646bfe0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.900508:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.900516:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.900523:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.901025:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfe1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.901039:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfe1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.901047:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfe1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574330.901059:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787574330.901372:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646bfe0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.901381:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646bfe0c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.901389:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646bfe0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.901396:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574330.901402:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646bfe0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.901423:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646bfe0c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.901438:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:0.0:1787574330.901441:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574330.901447:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646bfe0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.901453:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646bfe0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.901468:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.901474:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.901480:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.901485:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574330.901488:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.901495:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.901502:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982a0de1d700) 00010000:00010000:0.0:1787574330.901505:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574330.901508:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.901526:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.901584:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646bfe05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec42 expref: 30 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.901600:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfe1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec42 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.901608:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34d00) 00010000:00010000:0.0:1787574330.901610:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787574330.901613:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a41d00c00, rc 0) 00000100:00100000:0.0:1787574330.901711:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+29:10479:x1874407272265088:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1431us (2193us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1787574330.902592:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:2.0:1787574330.904358:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574330.904487:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272265216 00000100:00100000:0.0:1787574330.904500:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272265216 00000100:00100000:0.0:1787574330.904575:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:0.0:1787574330.904587:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+29:10479:x1874407272265216:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:0.0:1787574330.904665:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.904684:0:7646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfdcd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec2d expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.904694:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe28 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.904771:0:7646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfdcd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec2d expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.904786:0:7646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfdcd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec2d expref: 29 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574330.904804:0:7646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41dbbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7646:1874407290110592:192.168.206.51@tcp:104: 00000100:00100000:0.0:1787574330.906804:0:7646:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b6300 going to sleep for 11 seconds 00000100:00100000:2.0:1787574330.912426:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574330.912625:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272265472 00000100:00100000:3.0:1787574330.912638:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272265472 00000100:00100000:3.0:1787574330.912706:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:3.0:1787574330.912717:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+30:5589:x1874407272265472:12345-192.168.206.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787574330.913502:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+31:5589:x1874407272265472:12345-192.168.206.51@tcp:35:ldlm_bl.0 Request processed in 782us (1084us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787574330.913532:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:0.0:1787574330.915300:0:7646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41dbbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7646:1874407290110592:192.168.206.51@tcp:104: 00010000:00010000:0.0:1787574330.915337:0:7646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574330.916953:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574330.917118:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272265600 00000100:00100000:1.0:1787574330.917129:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272265600 00010000:00010000:1.0:1787574330.917217:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfdcd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec2d expref: 31 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574330.917350:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:1.0:1787574330.917362:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+31:2350:x1874407272265600:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574330.917381:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574330.917390:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfdcd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec2d expref: 31 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.917406:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfdcd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec2d expref: 31 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.917463:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bfdcd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec2d expref: 31 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.917484:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34d00) 00010000:00010000:1.0:1787574330.917491:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.917503:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.917511:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe28 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574330.917554:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574330.917639:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+30:2350:x1874407272265600:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 278us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574330.917648:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00010000:00010000:0.0:1787574330.917735:0:7646:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.917745:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.918303:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.918313:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.918321:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.918327:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574330.918332:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.918353:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.918367:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34d00) 00010000:00010000:0.0:1787574330.918370:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787574330.918375:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574330.918382:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574330.918453:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+29:10479:x1874407272265216:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 13866us (14104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574330.918463:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:3.0:1787574330.920370:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574330.921848:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272265856 00000100:00100000:1.0:1787574330.921866:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272265856 00000100:00100000:1.0:1787574330.921954:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:1.0:1787574330.921968:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+29:10479:x1874407272265856:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1787574330.922318:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+30:10479:x1874407272265856:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 351us (1959us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1787574330.922328:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:2.0:1787574330.993613:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574330.993642:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41dbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290110720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574330.993744:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574330.993948:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290110720 00000100:00100000:0.0:1787574330.993960:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290110720 00000100:00100000:0.0:1787574330.994025:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787574330.994037:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1874407290110720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787574330.994081:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574330.994205:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1874407290110720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574330.994213:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787574330.994384:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41dbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290110720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574331.021683:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574331.022026:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272266112 00000100:00100000:2.0:1787574331.022041:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272266112 00000100:00100000:2.0:1787574331.022161:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:2.0:1787574331.022210:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+30:10490:x1874407272266112:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:2.0:1787574331.022242:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574331.022274:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646bfe2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec49 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.022391:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646bfe36 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.022409:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646bfe36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.022425:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646bfe36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.022442:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646bfe3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.022462:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646bfe3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.022492:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646bfe3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.023273:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646bfe44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.023285:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646bfe44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.023294:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646bfe44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574331.023306:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00000100:00080000:1.0:1787574331.023560:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787574331.023800:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646bfe36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.023810:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646bfe36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.023818:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646bfe36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.023824:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fbe00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574331.023830:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646bfe36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.023838:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646bfe36 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.023853:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:2.0:1787574331.023857:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574331.023872:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646bfe36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.023878:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646bfe36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.023893:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646bfe3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.023900:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646bfe3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.023905:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646bfe3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.023910:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fa200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574331.023913:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646bfe3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.023918:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646bfe3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.023924:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982a03b34a00) 00010000:00010000:2.0:1787574331.023927:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574331.023929:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646bfe3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.023935:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646bfe3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.023996:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646bfe2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec49 expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.024025:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646bfe44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec49 expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.024032:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34d00) 00010000:00010000:2.0:1787574331.024034:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574331.024037:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fa400, rc 0) 00000100:00100000:2.0:1787574331.026668:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+32:10490:x1874407272266112:12345-192.168.206.51@tcp:101:cat.0 Request processed in 4448us (4982us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787574331.026685:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:2.0:1787574331.033843:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574331.034899:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272266368 00000100:00100000:1.0:1787574331.034917:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272266368 00000100:00100000:1.0:1787574331.035023:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:1.0:1787574331.035035:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+32:10490:x1874407272266368:12345-192.168.206.51@tcp:35:cat.0 00000100:00100000:1.0:1787574331.035387:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+33:10490:x1874407272266368:12345-192.168.206.51@tcp:35:cat.0 Request processed in 354us (1557us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787574331.035397:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:3.0:1787574331.058904:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574331.059068:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272266624 00000100:00100000:0.0:1787574331.059083:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272266624 00000100:00100000:0.0:1787574331.059219:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:0.0:1787574331.059234:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+33:10491:x1874407272266624:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:0.0:1787574331.059315:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787574331.059363:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646bfe44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec49 expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.059390:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfe1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec42 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.059404:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa800/0xfe91058e646bfde2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec34 expref: 31 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.059416:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a03b34d00) 00010000:00010000:0.0:1787574331.059430:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574331.059467:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.059484:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.059496:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.059512:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646bfe59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.059519:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646bfe59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.059527:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646bfe59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.059913:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe60 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.059936:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.059944:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787574331.060639:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1787574331.060652:0:5830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 307235486033ns, next at 308235483031ns, rc = 0 00010000:00010000:0.0:1787574331.060723:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646bfe67 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.060737:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646bfe67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.060748:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646bfe67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.060756:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646bfe67 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.060764:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646bfe67 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.060771:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646bfe67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.060807:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574331.060831:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.060837:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe60 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.060851:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.060858:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574331.060863:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.060871:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe60 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.060885:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a0de1da00) 00010000:00010000:0.0:1787574331.060889:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787574331.060893:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe60 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.060899:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe60 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.060920:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.060926:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe52 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.060931:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.060937:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574331.060940:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.060956:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.060965:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:0.0:1787574331.060967:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574331.060970:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe52 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.060976:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe52 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574331.060987:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028f85cea reply state 00000000e3b6402f transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646bfe59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574331.060997:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574331.061112:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+32:10491:x1874407272266624:12345-192.168.206.51@tcp:36:rm.0 Request processed in 1866us (2210us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1787574331.061121:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 95 00010000:00010000:3.0:1787574331.061454:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574331.061462:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646bfe67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.061468:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01400 already unused, calling callback (ffffffffc142f230) 00010000:00010000:3.0:1787574331.061472:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646bfe67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.061480:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646bfe67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.061490:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982a0de1da00) 00010000:00010000:3.0:1787574331.061493:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787574331.061495:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646bfe67 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.061501:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646bfe67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.061517:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574331.061519:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574331.061521:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574331.070601:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646bfe59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.070626:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646bfe59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.070634:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646bfe59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.070641:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574331.070646:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646bfe59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.070654:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646bfe59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.070678:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982a0de1d700) 00010000:00010000:1.0:1787574331.070682:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574331.070688:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646bfe59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.070694:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646bfe59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574331.116051:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574331.116223:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272266880 00000100:00100000:0.0:1787574331.116236:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272266880 00000100:00100000:0.0:1787574331.116322:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:0.0:1787574331.116334:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+31:10497:x1874407272266880:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1787574331.116365:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574331.116391:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe6e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec50 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.116753:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.116939:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.116955:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.116974:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfe7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.116982:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfe7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.116988:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfe7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787574331.118038:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1787574331.118568:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646bfe83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.118587:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646bfe83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.118601:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646bfe83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.118653:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.118709:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe75 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.118718:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.118860:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574331.118865:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.118874:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe75 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.118889:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:0.0:1787574331.118892:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574331.118897:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe75 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.118902:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646bfe75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574331.118918:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a72d0958 reply state 00000000f5850eff transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfe7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574331.118929:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787574331.118976:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646bfe6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec50 expref: 34 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.118991:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646bfe83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec50 expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.118998:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1db00) 00010000:00010000:0.0:1787574331.119001:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574331.119003:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a41d00000, rc 0) 00000100:00100000:0.0:1787574331.119230:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+34:10497:x1874407272266880:12345-192.168.206.51@tcp:101:bash.0 Request processed in 2897us (3194us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787574331.119249:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 96 00010000:00010000:2.0:1787574331.124429:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574331.146906:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574331.147027:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272267008 00000100:00100000:2.0:1787574331.147041:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272267008 00000100:00100000:2.0:1787574331.147152:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:2.0:1787574331.147200:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2351:x1874407272267008:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1787574331.147224:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574331.147252:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfe91 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec57 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787574331.147285:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787574331.147524:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=307s v=(0 0) 00010000:00010000:2.0:1787574331.147531:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574331.147544:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfe91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec57 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.147591:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfe91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec57 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.147609:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069faa00, rc 0) 00000100:00100000:2.0:1787574331.147675:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2351:x1874407272267008:12345-192.168.206.51@tcp:101:bash.0 Request processed in 512us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574331.147682:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00080000:0.0:1787574331.147892:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787574331.148138:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfe7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.148162:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfe7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.148200:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfe7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.148207:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574331.148213:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfe7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.148222:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfe7c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.148240:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982a0de1d300) 00010000:00010000:3.0:1787574331.148244:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574331.148249:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfe7c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.148256:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646bfe7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574331.152588:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574331.152693:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272267136 00000100:00100000:2.0:1787574331.152707:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272267136 00000100:00100000:2.0:1787574331.152791:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:2.0:1787574331.152803:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41db9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:10497:x1874407272267136:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1787574331.152826:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574331.152849:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044f7b2f2/0xfe91058e646bfe98 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec5e expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.152886:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfe91 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec57 expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.152897:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574331.152902:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574331.152909:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044f7b2f2/0xfe91058e646bfe98 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec5e expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.152952:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfe91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec57 expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.152982:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfe91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec57 expref: 9 pid: 6682 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574331.152999:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6681:1874407290110848:192.168.206.51@tcp:104: 00000100:00100000:2.0:1787574331.153124:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3a6c3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574331.156455:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574331.156715:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272267264 00000100:00100000:3.0:1787574331.156739:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272267264 00010000:00010000:3.0:1787574331.156805:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfe91 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec57 expref: 10 pid: 6682 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574331.156860:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:3.0:1787574331.156871:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a063a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+10:2351:x1874407272267264:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574331.156889:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574331.156935:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfe91 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec57 expref: 10 pid: 6682 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.156951:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfe91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec57 expref: 10 pid: 6682 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.156984:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574331.156989:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574331.156998:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000044f7b2f2/0xfe91058e646bfe98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec5e expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.157009:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044f7b2f2/0xfe91058e646bfe98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec5e expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.157064:0:8453:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000044f7b2f2/0xfe91058e646bfe98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec5e expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574331.157081:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a418fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8453:1874407290110976:192.168.206.51@tcp:105: 00000100:00100000:3.0:1787574331.157229:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0828c6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787574331.158114:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfe91 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec57 expref: 10 pid: 6682 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574331.158135:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6681:1874407290110848:192.168.206.51@tcp:104: 00010000:00010000:2.0:1787574331.158189:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000044f7b2f2/0xfe91058e646bfe98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec5e expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.158204:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fa200, rc 0) 00000100:00100000:2.0:1787574331.158274:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41db9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:10497:x1874407272267136:12345-192.168.206.51@tcp:101:bash.0 Request processed in 5473us (5699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574331.158284:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:0.0:1787574331.171709:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574331.172041:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a418fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8453:1874407290110976:192.168.206.51@tcp:105: 00010000:00010000:3.0:1787574331.172074:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574331.172157:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a063a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2351:x1874407272267264:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 15286us (15725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574331.172196:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:1.0:1787574331.172346:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272267520 00000100:00100000:1.0:1787574331.172365:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272267520 00000100:00100000:1.0:1787574331.172426:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:1.0:1787574331.172437:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+33:10497:x1874407272267520:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:1.0:1787574331.172854:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+34:10497:x1874407272267520:12345-192.168.206.51@tcp:35:bash.0 Request processed in 417us (1163us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1787574331.172862:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:0.0:1787574331.364813:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574331.368225:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272267648 00000100:00100000:3.0:1787574331.368245:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272267648 00000100:00100000:3.0:1787574331.368359:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:3.0:1787574331.368373:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+34:10513:x1874407272267648:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1787574331.368407:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574331.368438:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bfe9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec65 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.368537:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfea6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.368566:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.368581:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574331.368660:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787574331.368666:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787574331.368698:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.368735:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bfe9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec65 expref: 36 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.368760:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfea6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec65 expref: 35 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.368772:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:3.0:1787574331.368776:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574331.368780:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142600, rc 0) 00000100:00100000:3.0:1787574331.368878:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+35:10513:x1874407272267648:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 509us (4161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574331.368895:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:0.0:1787574331.376950:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574331.377083:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272267904 00000100:00100000:1.0:1787574331.377107:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272267904 00000100:00100000:1.0:1787574331.377223:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:1.0:1787574331.377235:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+35:10513:x1874407272267904:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1787574331.377266:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574331.377294:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646bfead lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec6c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.377437:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646bfeb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.377466:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646bfeb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.377671:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646bfeb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574331.377691:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787574331.377941:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646bfead lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec6c expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.377963:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646bfeb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec6c expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.377994:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1db00) 00010000:00010000:1.0:1787574331.377997:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787574331.378002:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0000, rc 0) 00000100:00100000:1.0:1787574331.379872:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+37:10513:x1874407272267904:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 2627us (2928us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787574331.379886:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:0.0:1787574331.391042:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574331.391983:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574331.392219:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272268288 00000100:00100000:3.0:1787574331.392231:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272268288 00000100:00100000:3.0:1787574331.392350:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00100000:3.0:1787574331.392364:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+37:10513:x1874407272268288:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1787574331.392394:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574331.392422:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bfec2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec73 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.392562:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfec9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.392579:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfec9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.392592:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfec9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574331.392607:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787574331.392833:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bfec2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec73 expref: 40 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.392858:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfec9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec73 expref: 39 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.392868:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1db00) 00010000:00010000:3.0:1787574331.392872:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787574331.392876:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16143000, rc 0) 00000100:00100000:3.0:1787574331.392985:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+39:10513:x1874407272268288:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 623us (1006us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1787574331.392994:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00100000:2.0:1787574331.393341:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272268032 00000100:00100000:2.0:1787574331.393349:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272268032 00000100:00100000:2.0:1787574331.393678:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:2.0:1787574331.393691:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41893100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+39:2351:x1874407272268032:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574331.393704:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574331.393729:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646bfeb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec6c expref: 39 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.393763:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1db00) 00010000:00010000:2.0:1787574331.393767:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574331.393811:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41893100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+38:2351:x1874407272268032:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 124us (2785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574331.393818:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:0.0:1787574331.398369:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574331.398454:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272268416 00000100:00100000:2.0:1787574331.398466:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272268416 00000100:00100000:2.0:1787574331.398544:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:2.0:1787574331.398557:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a14f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2350:x1874407272268416:12345-192.168.206.51@tcp:1:lfs.0 00010000:00010000:2.0:1787574331.398614:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfed7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.398637:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000044f7b2f2/0xfe91058e646bfe98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec5e expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.398645:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574331.398649:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574331.398654:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfed7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.398711:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000044f7b2f2/0xfe91058e646bfe98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec5e expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.398728:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000044f7b2f2/0xfe91058e646bfe98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec5e expref: 8 pid: 6681 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574331.398780:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6682:1874407290111104:192.168.206.51@tcp:104: 00000100:00100000:2.0:1787574331.398903:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3a6c3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787574331.402858:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574331.403046:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6682:1874407290111104:192.168.206.51@tcp:104: 00010000:00010000:2.0:1787574331.403105:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfed7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574331.406809:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272268544 00000100:00100000:0.0:1787574331.406832:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272268544 00002000:00100000:0.0:1787574331.406909:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff982a11bb5500 x1874407272268544/t0(0) o4->a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp:102/0 lens 504/0 e 0 to 0 dl 1787574342 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787574331.406922:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a11bb5500 with x1874407272268544 ext(0->8) 00010000:00010000:0.0:1787574331.406935:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000044f7b2f2/0xfe91058e646bfe98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec5e expref: 9 pid: 6681 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.406956:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000044f7b2f2/0xfe91058e646bfe98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec5e expref: 9 pid: 6681 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787574331.406965:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff982a11bb5500 00000100:00100000:0.0:1787574331.406998:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:0.0:1787574331.407010:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:2350:x1874407272268544:12345-192.168.206.51@tcp:4:lfs.0 00000100:00100000:0.0:1787574331.407675:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+11:2350:x1874407272268544:12345-192.168.206.51@tcp:4:lfs.0 Request processed in 663us (4828us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787574331.407691:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00002000:00100000:0.0:1787574331.407701:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff982a11bb5500 x1874407272268544/t4294967302(0) o4->a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp:102/0 lens 504/448 e 0 to 0 dl 1787574342 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787574331.407711:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a11bb5500 with x1874407272268544 ext(0->8) 00010000:00010000:0.0:1787574331.407720:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000044f7b2f2/0xfe91058e646bfe98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec5e expref: 11 pid: 6681 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.407737:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000044f7b2f2/0xfe91058e646bfe98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec5e expref: 11 pid: 6681 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787574331.407745:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff982a11bb5500 00000100:00100000:3.0:1787574331.410304:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574331.410416:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272268672 00000100:00100000:1.0:1787574331.410428:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272268672 00010000:00010000:1.0:1787574331.410494:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000044f7b2f2/0xfe91058e646bfe98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec5e expref: 11 pid: 6681 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574331.410544:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:1.0:1787574331.410557:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+11:2352:x1874407272268672:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574331.410577:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787574331.410600:0:5817:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787574331.410603:0:5817:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787574331 00002000:00010000:1.0:1787574331.410605:0:5817:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787574331 00002000:00010000:1.0:1787574331.410607:0:5817:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787574331 00010000:00010000:1.0:1787574331.410615:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000044f7b2f2/0xfe91058e646bfe98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec5e expref: 11 pid: 6681 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.410631:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000044f7b2f2/0xfe91058e646bfe98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec5e expref: 11 pid: 6681 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.410677:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044f7b2f2/0xfe91058e646bfe98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec5e expref: 11 pid: 6681 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.410696:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787574331.410700:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787574331.410707:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfed7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.410718:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfed7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.410775:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787574331.410936:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfed7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.410947:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfed7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.410982:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfed7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.410992:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfed7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.411000:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfed7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.411007:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069faa00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574331.411012:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfed7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.411044:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfed7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.411061:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfed7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.411069:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dad1fdd0/0xfe91058e646bfed7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574331.411387:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+10:2352:x1874407272268672:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 830us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574331.411396:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:2.0:1787574331.413639:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a14f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:2350:x1874407272268416:12345-192.168.206.51@tcp:1:lfs.0 Request processed in 15068us (15269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574331.413659:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:2.0:1787574331.418158:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574331.418418:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272268928 00000100:00100000:1.0:1787574331.418432:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272268928 00000100:00100000:1.0:1787574331.418634:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:1.0:1787574331.418649:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a03534c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+38:10513:x1874407272268928:12345-192.168.206.51@tcp:35:lfs.0 00000004:00010000:1.0:1787574331.418760:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfec9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec73 expref: 38 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787574331.419322:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1787574331.419368:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1787574331.420326:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1787574331.420418:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfede lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.420672:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646bfe83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec50 expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.420684:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfede lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.420738:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646bfe83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec50 expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.420760:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646bfe83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec50 expref: 42 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574331.420844:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11bb4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1874407290111232:192.168.206.51@tcp:104: 00000100:00100000:1.0:1787574331.421273:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056a9840 going to sleep for 11 seconds 00000100:00100000:1.0:1787574331.425447:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11bb4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1874407290111232:192.168.206.51@tcp:104: 00000100:00100000:2.0:1787574331.425476:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574331.425595:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272269056 00000100:00100000:0.0:1787574331.425606:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272269056 00010000:00010000:0.0:1787574331.425658:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646bfe83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec50 expref: 43 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574331.425705:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:0.0:1787574331.425715:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+43:2351:x1874407272269056:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574331.425732:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574331.425739:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646bfe83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec50 expref: 43 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.425753:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646bfe83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec50 expref: 43 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.425786:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646bfe83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec50 expref: 43 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.425861:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1db00) 00010000:00010000:0.0:1787574331.425868:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfede lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.425878:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfede lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.425886:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfede lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.425908:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574331.426115:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+42:2351:x1874407272269056:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 399us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574331.426125:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 51 00010000:00010000:1.0:1787574331.426370:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfede lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.426382:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfede lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.426388:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfede lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787574331.426813:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787574331.431918:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1787574331.432225:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11bb4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1874407290111360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787574331.432331:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574331.432385:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056a9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574331.433135:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290111360 00000100:00100000:3.0:1787574331.433147:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290111360 00000100:00100000:3.0:1787574331.433256:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787574331.433268:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5833:x1874407290111360:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787574331.433393:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5833:x1874407290111360:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 126us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574331.433401:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787574331.433911:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11bb4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1874407290111360:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787574331.434551:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1787574331.434665:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11bb4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1874407290111488:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787574331.434725:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574331.434773:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a26fc6780 going to sleep for 11 seconds 00000100:00100000:3.0:1787574331.435118:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290111488 00000100:00100000:3.0:1787574331.435127:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290111488 00000100:00100000:3.0:1787574331.435214:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787574331.435225:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5833:x1874407290111488:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787574331.435458:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5833:x1874407290111488:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 235us (732us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787574331.435467:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787574331.435615:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11bb4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1874407290111488:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787574331.435686:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1787574331.435732:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfede lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.435746:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfede lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.435754:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfede lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.435772:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574331.435778:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfede lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.435788:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfede lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.435809:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1db00) 00010000:00010000:1.0:1787574331.435812:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787574331.435818:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfede lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.435841:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfede lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787574331.436070:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787574331.436237:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1787574331.436250:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 307611083968ns, next at 308611081746ns, rc = 0 00000001:00080000:1.0:1787574331.436258:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1787574331.436290:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1db00) 00010000:00010000:1.0:1787574331.436293:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787574331.436302:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646bfec9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec73 expref: 46 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574331.436458:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a03534c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+45:10513:x1874407272268928:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 17811us (18315us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1787574331.436466:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000020:00080000:1.0:1787574331.436898:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787574331.439412:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574331.439513:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272269184 00000100:00100000:0.0:1787574331.439526:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272269184 00000100:00100000:0.0:1787574331.439594:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:0.0:1787574331.439606:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+45:10513:x1874407272269184:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1787574331.439635:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574331.439662:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646bfee5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec7a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.439737:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646bfee5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec7a expref: 46 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.439754:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646bfee5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec7a expref: 46 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.439920:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:0.0:1787574331.439923:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787574331.439928:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a41d00000, rc 0) 00000100:00100000:0.0:1787574331.440013:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+46:10513:x1874407272269184:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 409us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574331.440021:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:2.0:1787574331.444907:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574331.445051:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272269440 00000100:00100000:1.0:1787574331.445065:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272269440 00000100:00100000:1.0:1787574331.445151:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:1.0:1787574331.445186:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+46:10513:x1874407272269440:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1787574331.445514:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+47:10513:x1874407272269440:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 349us (618us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1787574331.445522:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:3.0:1787574331.579515:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574331.579694:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272269568 00000100:00100000:1.0:1787574331.579709:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272269568 00000100:00100000:1.0:1787574331.579795:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:1.0:1787574331.579808:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+47:10523:x1874407272269568:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:1.0:1787574331.579925:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfeec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.579949:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfeec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.579964:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfeec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.579983:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646bfef3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.579990:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646bfef3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.579997:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646bfef3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580290:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646bfefa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580301:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646bfefa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580308:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646bfefa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787574331.580366:0:7646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646bfefa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580380:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfeec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580398:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfeec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580405:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfeec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580413:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574331.580418:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfeec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580427:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfeec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580442:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:1.0:1787574331.580445:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574331.580451:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfeec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580457:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfeec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580473:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646bfef3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580479:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646bfef3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580486:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646bfef3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580491:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574331.580501:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646bfef3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580752:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646bfef3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580829:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982a04da2400) 00010000:00010000:1.0:1787574331.580833:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574331.580837:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646bfef3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580843:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646bfef3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580864:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646bfefa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580869:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646bfefa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580876:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646bfefa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580881:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0a00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574331.580884:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646bfefa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580890:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646bfefa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580898:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:1.0:1787574331.580900:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574331.580911:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646bfefa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.580917:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646bfefa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574331.581087:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+47:10523:x1874407272269568:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 1277us (1594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574331.581109:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:0.0:1787574331.645302:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574331.645727:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272269824 00000100:00100000:3.0:1787574331.645741:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272269824 00000100:00100000:3.0:1787574331.645829:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 102 00000100:00100000:3.0:1787574331.645843:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+47:10526:x1874407272269824:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1787574331.645871:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574331.645900:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bff01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec81 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.646022:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.646042:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.646056:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.646075:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.646083:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.646090:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.646292:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bff16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.646303:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bff16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.646311:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bff16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574331.646322:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787574331.646991:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.647004:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff08 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.647022:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.647028:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16143800 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574331.647032:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.647040:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff08 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.647056:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:3.0:1787574331.647059:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574331.647063:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.647068:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.647085:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.647090:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.647107:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.647112:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574331.647115:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.647131:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.647140:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982a04dc0f00) 00010000:00010000:3.0:1787574331.647142:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574331.647146:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.647152:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.647318:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bff01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec81 expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.647336:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bff16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec81 expref: 49 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.647345:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:3.0:1787574331.647347:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574331.647349:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142000, rc 0) 00000100:00100000:3.0:1787574331.647679:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+49:10526:x1874407272269824:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1837us (2389us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787574331.647690:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 102 00000100:00100000:3.0:1787574331.651360:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574331.651583:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272269952 00000100:00100000:0.0:1787574331.651596:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272269952 00000100:00100000:0.0:1787574331.651670:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:0.0:1787574331.651682:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+49:10526:x1874407272269952:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:0.0:1787574331.651782:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646bff24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.651802:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646bff24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.651814:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646bff24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.651846:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646bff24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.651854:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646bff24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.651861:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646bff24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.651886:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00800 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574331.651891:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646bff24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.651899:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646bff24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.651915:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:0.0:1787574331.651918:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787574331.651923:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646bff24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.651930:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646bff24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574331.652026:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+49:10526:x1874407272269952:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 345us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574331.652037:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:0.0:1787574331.655079:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574331.655268:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272270208 00000100:00100000:1.0:1787574331.655283:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272270208 00000100:00100000:1.0:1787574331.655357:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:1.0:1787574331.655370:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+49:10526:x1874407272270208:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1787574331.655994:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+50:10526:x1874407272270208:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 624us (928us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1787574331.656005:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:3.0:1787574331.672694:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574331.672812:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574331.672848:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574331.672882:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574331.673042:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272270592 00000100:00100000:1.0:1787574331.673056:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272270592 00000100:00100000:1.0:1787574331.673141:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272270464 00000100:00100000:1.0:1787574331.673145:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272270464 00000100:00100000:1.0:1787574331.673229:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:1.0:1787574331.673241:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:2352:x1874407272270592:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574331.673338:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:2352:x1874407272270592:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 98us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574331.673347:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:1.0:1787574331.673377:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:1.0:1787574331.673385:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2352:x1874407272270464:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574331.673426:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2352:x1874407272270464:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 42us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574331.673433:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00080000:1.0:1787574331.673452:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574331.673466:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272270720 00000100:00100000:1.0:1787574331.673469:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272270720 00000100:00100000:1.0:1787574331.673508:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 133 00000100:00100000:1.0:1787574331.673516:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2352:x1874407272270720:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574331.673548:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2352:x1874407272270720:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 33us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574331.673555:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 133 00000100:00080000:1.0:1787574331.673569:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574331.679448:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272270336 00000100:00100000:0.0:1787574331.679469:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272270336 00000100:00100000:0.0:1787574331.679547:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 287 00000100:00100000:0.0:1787574331.679560:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04965050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:2352:x1874407272270336:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574331.679886:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04965050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:2352:x1874407272270336:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 326us (7206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574331.679896:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 287 00000100:00100000:3.0:1787574331.729024:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574331.730356:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272270976 00000100:00100000:0.0:1787574331.730373:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272270976 00000100:00100000:0.0:1787574331.730528:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:0.0:1787574331.730541:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+50:10536:x1874407272270976:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1787574331.730573:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574331.730577:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787574331.730613:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bfea6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec65 expref: 50 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.730638:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:0.0:1787574331.730643:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574331.730661:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646bff2b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec88 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.730802:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646bff32 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.730819:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bff16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec81 expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.730828:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646bff32 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.730874:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bff16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec81 expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.730891:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bff16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec81 expref: 50 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574331.730906:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41890700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874407290111616:192.168.206.51@tcp:104: 00000100:00100000:0.0:1787574331.731047:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574331.739974:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574331.740042:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272271104 00000100:00100000:1.0:1787574331.740053:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272271104 00000100:00100000:3.0:1787574331.740071:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41890700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874407290111616:192.168.206.51@tcp:104: 00010000:00010000:3.0:1787574331.740120:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646bff32 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.740133:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bff16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec81 expref: 51 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574331.740355:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:2.0:1787574331.740372:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41892d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+51:2350:x1874407272271104:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574331.740391:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574331.740400:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bff16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec81 expref: 51 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.740417:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bff16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec81 expref: 51 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.740465:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bff16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec81 expref: 51 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.740486:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:2.0:1787574331.740491:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646bff32 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.740502:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646bff32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.740526:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646bff32 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.740553:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574331.740626:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41892d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+50:2350:x1874407272271104:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 258us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574331.740634:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 52 00010000:00010000:3.0:1787574331.742496:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646bff32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.742517:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646bff32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574331.742547:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787574331.742903:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646bff2b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec88 expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.742927:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646bff32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec88 expref: 50 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.742938:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:3.0:1787574331.742941:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787574331.742944:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a41d00e00, rc 0) 00000100:00100000:3.0:1787574331.743082:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+50:10536:x1874407272270976:12345-192.168.206.51@tcp:101:bash.0 Request processed in 12541us (14073us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787574331.743092:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:1.0:1787574331.751470:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574331.751643:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272271360 00000100:00100000:3.0:1787574331.751658:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272271360 00000100:00100000:3.0:1787574331.751731:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 105 00000100:00100000:3.0:1787574331.751744:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+50:10536:x1874407272271360:12345-192.168.206.51@tcp:36:bash.0 00010000:00010000:3.0:1787574331.752196:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bff40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.752218:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bff40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.752232:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bff40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787574331.752297:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1787574331.752326:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eabc129b reply state 000000009cb30a40 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bff40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574331.752336:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787574331.752456:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+53:10536:x1874407272271360:12345-192.168.206.51@tcp:36:bash.0 Request processed in 712us (999us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1787574331.752465:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 105 00000020:00080000:3.0:1787574331.752471:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787574331.754088:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bff40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.754119:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bff40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.755487:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bff40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.755496:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574331.755501:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bff40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.755512:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bff40 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.755555:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:3.0:1787574331.755558:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574331.755563:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bff40 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.756525:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bff40 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574331.756939:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574331.758042:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272271488 00000100:00100000:3.0:1787574331.758061:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272271488 00000100:00100000:3.0:1787574331.758158:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 106 00000100:00100000:3.0:1787574331.758190:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+52:10536:x1874407272271488:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1787574331.758221:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574331.758245:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bff47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec8f expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.758365:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.758382:0:7646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646bff32 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec88 expref: 53 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.758393:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff4e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.758440:0:7646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646bff32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec88 expref: 53 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.758456:0:7646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646bff32 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec88 expref: 53 pid: 5830 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574331.758487:0:7646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a418f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7646:1874407290111744:192.168.206.51@tcp:104: 00000100:00100000:3.0:1787574331.758615:0:7646:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0828c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787574331.761966:0:7646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a418f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7646:1874407290111744:192.168.206.51@tcp:104: 00010000:00010000:3.0:1787574331.762006:0:7646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574331.768749:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574331.768870:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272271616 00000100:00100000:2.0:1787574331.768883:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272271616 00010000:00010000:2.0:1787574331.768936:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646bff32 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec88 expref: 54 pid: 5830 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574331.768987:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:2.0:1787574331.769000:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+54:2351:x1874407272271616:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574331.769019:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574331.769027:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646bff32 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec88 expref: 54 pid: 5830 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.769066:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646bff32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec88 expref: 54 pid: 5830 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.769105:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646bff32 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec88 expref: 54 pid: 5830 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.769126:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:2.0:1787574331.769131:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.769142:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.769151:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff4e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.769240:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574331.769309:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+53:2351:x1874407272271616:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 312us (574us total) trans 0 rc 0/0 00010000:00010000:3.0:1787574331.769312:0:7646:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574331.769319:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 53 00010000:00010000:3.0:1787574331.769338:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574331.769394:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787574331.769399:0:7646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787574331.769422:0:7646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.769504:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bff47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec8f expref: 53 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.769539:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec8f expref: 52 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.769549:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:3.0:1787574331.769553:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574331.769565:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142400, rc 0) 00000100:00100000:3.0:1787574331.769636:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+52:10536:x1874407272271488:12345-192.168.206.51@tcp:101:bash.0 Request processed in 11438us (12691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574331.769652:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 106 00000100:00100000:2.0:1787574331.774557:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574331.774713:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272271872 00000100:00100000:1.0:1787574331.774726:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272271872 00000100:00100000:1.0:1787574331.774801:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:1.0:1787574331.774814:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+52:10536:x1874407272271872:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:1.0:1787574331.775133:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+53:10536:x1874407272271872:12345-192.168.206.51@tcp:35:bash.0 Request processed in 321us (589us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1787574331.775159:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:1.0:1787574331.852286:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574331.852425:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272272000 00000100:00100000:3.0:1787574331.852438:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272272000 00000100:00100000:3.0:1787574331.852512:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 107 00000100:00100000:3.0:1787574331.852525:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+53:10542:x1874407272272000:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1787574331.852555:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574331.852580:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bff55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec96 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.852743:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bff5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.853045:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bff5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.853063:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bff5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574331.853723:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787574331.853730:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787574331.853948:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bff5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.853993:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bff55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec96 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.854018:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bff5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec96 expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.854054:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:3.0:1787574331.854058:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574331.854062:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142200, rc 0) 00000100:00100000:3.0:1787574331.854195:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+54:10542:x1874407272272000:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1643us (1892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574331.854205:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 107 00000100:00100000:2.0:1787574331.859062:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574331.859752:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272272128 00000100:00100000:1.0:1787574331.859775:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272272128 00000100:00100000:1.0:1787574331.859899:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 108 00000100:00100000:1.0:1787574331.859912:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+54:10542:x1874407272272128:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1787574331.859940:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574331.859967:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bff63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ec9d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860048:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646bff6a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860064:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646bff6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860076:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646bff6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860106:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bff71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860116:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bff71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860123:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bff71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860291:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646bff78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860313:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646bff78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860321:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646bff78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574331.860367:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787574331.860372:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787574331.860393:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646bff78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860408:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646bff78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860417:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646bff6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860423:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646bff6a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860429:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646bff6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860436:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0e00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574331.860441:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646bff6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860450:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646bff6a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860464:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:1.0:1787574331.860467:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574331.860480:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646bff6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860486:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646bff6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860500:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bff71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860506:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bff71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860511:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bff71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860516:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574331.860519:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bff71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860524:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bff71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860531:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982a04da2400) 00010000:00010000:1.0:1787574331.860533:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574331.860536:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bff71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860541:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bff71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.860574:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bff63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec9d expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.861296:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646bff78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec9d expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.861309:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:1.0:1787574331.861312:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787574331.861315:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0800, rc 0) 00000100:00100000:1.0:1787574331.861412:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+55:10542:x1874407272272128:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1500us (2361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574331.861421:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 108 00000100:00100000:2.0:1787574331.868084:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574331.868223:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574331.868306:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272272512 00000100:00100000:3.0:1787574331.868318:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272272512 00000100:00100000:3.0:1787574331.868396:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:3.0:1787574331.868408:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+55:10542:x1874407272272512:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1787574331.868434:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574331.868459:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bff7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eca4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.868594:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.868612:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec8f expref: 56 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.868620:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646bff78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec9d expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.868629:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff86 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.868672:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646bff78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec9d expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.868704:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646bff78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec9d expref: 56 pid: 5830 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574331.868721:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a418f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874407290111872:192.168.206.51@tcp:104: 00010000:00010000:3.0:1787574331.868847:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec8f expref: 56 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.868858:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec8f expref: 56 pid: 7646 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574331.868867:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a418faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874407290112000:192.168.206.51@tcp:104: 00000100:00100000:3.0:1787574331.868891:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0828ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574331.870126:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272272256 00000100:00100000:1.0:1787574331.870139:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272272256 00010000:00010000:1.0:1787574331.870402:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646bff78 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec9d expref: 57 pid: 5830 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574331.870494:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:1.0:1787574331.870506:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+57:2351:x1874407272272256:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574331.870520:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574331.870528:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646bff78 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec9d expref: 57 pid: 5830 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.870542:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646bff78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec9d expref: 57 pid: 5830 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.870578:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:1.0:1787574331.870584:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.870614:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574331.870620:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574331.870689:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+57:2351:x1874407272272256:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 185us (2619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574331.870697:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:2.0:1787574331.883349:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:3.0:1787574331.883859:0:5831:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.51@tcp) returned -22 from blocking AST (req@0000000078f363a2 x1874407290111872) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646bff78 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec9d expref: 56 pid: 5830 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.883890:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646bff78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec9d expref: 56 pid: 5830 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574331.883913:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a418f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874407290111872:192.168.206.51@tcp:104: 00000100:00100000:3.0:1787574331.883931:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a418faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874407290112000:192.168.206.51@tcp:104: 00010000:00010000:3.0:1787574331.883960:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:3.0:1787574331.883966:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.883998:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.884008:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574331.885426:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272272640 00000100:00100000:0.0:1787574331.885445:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272272640 00010000:00010000:0.0:1787574331.885509:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec8f expref: 56 pid: 7646 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574331.885554:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:0.0:1787574331.885565:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a063a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+56:2351:x1874407272272640:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574331.885583:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574331.885590:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec8f expref: 56 pid: 7646 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.885614:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec8f expref: 56 pid: 7646 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.885640:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646bff4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec8f expref: 56 pid: 7646 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.885661:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:0.0:1787574331.885666:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.885677:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.885687:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff86 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.885739:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574331.886562:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a063a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+55:2351:x1874407272272640:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 258us (2486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574331.886587:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 55 00010000:00010000:3.0:1787574331.886832:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.886845:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574331.886872:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787574331.887073:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bff7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eca4 expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.887110:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eca4 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.887121:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:3.0:1787574331.887125:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787574331.887128:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16143800, rc 0) 00000100:00100000:3.0:1787574331.887214:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+55:10542:x1874407272272512:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 18808us (18990us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1787574331.887223:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:2.0:1787574331.898738:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574331.901375:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272272896 00000100:00100000:3.0:1787574331.901393:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272272896 00000100:00100000:3.0:1787574331.901492:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:3.0:1787574331.901504:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+55:10542:x1874407272272896:12345-192.168.206.51@tcp:103:lfs.0 00010000:00010000:3.0:1787574331.901552:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574331.901586:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646bfee5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec7a expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574331.901611:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:3.0:1787574331.901617:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574331.902468:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+54:10542:x1874407272272896:12345-192.168.206.51@tcp:103:lfs.0 Request processed in 959us (3738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574331.902481:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:2.0:1787574331.907039:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574331.907330:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272273024 00000100:00100000:3.0:1787574331.907345:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272273024 00000100:00100000:2.0:1787574331.907732:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:2.0:1787574331.907765:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+54:10542:x1874407272273024:12345-192.168.206.51@tcp:58:lfs.0 00010000:00010000:2.0:1787574331.907910:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646bff94 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.907933:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646bff94 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574331.907947:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646bff94 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787574331.908818:0:7646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787574331.909047:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+54:10542:x1874407272273024:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 1283us (2016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574331.909068:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:2.0:1787574331.917076:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574331.922576:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272273152 00000100:00100000:0.0:1787574331.922597:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272273152 00000100:00100000:0.0:1787574331.922749:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:0.0:1787574331.922770:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+54:10542:x1874407272273152:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1787574331.922797:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574331.922824:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00a00/0xfe91058e646bff9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ecab expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.922897:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646bff94 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.922910:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00a00/0xfe91058e646bff9b lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecab expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.922934:0:5832:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646bff94 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.922947:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00a00/0xfe91058e646bff9b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecab expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.922963:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:0.0:1787574331.922967:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787574331.922971:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00a00/0xfe91058e646bff9b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecab expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574331.923000:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a41d00a00, rc 0) 00000100:00100000:0.0:1787574331.923118:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+55:10542:x1874407272273152:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 358us (6055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574331.923614:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:3.0:1787574332.019139:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574332.019196:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290112128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574332.019286:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574332.019532:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290112128 00000100:00100000:0.0:1787574332.019543:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290112128 00000100:00080000:1.0:1787574332.019626:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574332.019631:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787574332.019644:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874407290112128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574332.019689:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574332.019766:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874407290112128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574332.019775:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787574332.019855:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290112128:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787574332.145541:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787574332.401768:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787574332.401780:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787574332.402511:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1787574332.402528:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787574332.402701:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a418f8380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874407290112256:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787574332.402872:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0828c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574332.413937:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574332.414035:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272273280 00000100:00100000:1.0:1787574332.414045:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272273280 00000100:00100000:1.0:1787574332.414123:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:1.0:1787574332.414136:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+56:10544:x1874407272273280:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787574332.414207:0:5830:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787574332.414363:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+56:10544:x1874407272273280:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 227us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574332.414371:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:3.0:1787574332.414977:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a418f8380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874407290112256:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787574332.421115:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574332.421223:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272273408 00000100:00100000:3.0:1787574332.421237:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272273408 00000100:00100000:3.0:1787574332.421319:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:3.0:1787574332.421333:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+55:10544:x1874407272273408:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787574332.421455:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bffa2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421475:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bffa2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421487:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bffa2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421505:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bffa9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421513:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bffa9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421518:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bffa9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421544:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bffb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421552:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bffb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421558:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bffb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574332.421604:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787574332.421608:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787574332.421621:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bffb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421632:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bffa2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421644:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bffa2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421651:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bffa2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421658:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16143a00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574332.421663:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bffa2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421670:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bffa2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421684:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982a04da2c00) 00010000:00010000:3.0:1787574332.421687:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574332.421692:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bffa2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421698:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646bffa2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421713:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bffa9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421719:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bffa9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421725:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bffa9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421730:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574332.421738:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bffa9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421744:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bffa9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421751:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff982a04dc0f00) 00010000:00010000:3.0:1787574332.421754:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574332.421757:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bffa9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421763:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646bffa9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421782:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bffb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421789:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bffb0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421795:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bffb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421800:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574332.421803:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bffb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421808:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bffb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421815:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:3.0:1787574332.421817:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574332.421825:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bffb0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.421831:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646bffb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574332.421930:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+55:10544:x1874407272273408:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 600us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574332.421939:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:0.0:1787574332.427684:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574332.427775:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272273664 00000100:00100000:1.0:1787574332.427787:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272273664 00000100:00100000:1.0:1787574332.427855:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:1.0:1787574332.427866:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+55:10544:x1874407272273664:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787574332.427891:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574332.427916:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bffb7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ecb2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.428029:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bffbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.428059:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bffbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.428072:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bffbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574332.428084:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787574332.428547:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bffbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.428558:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bffbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.428565:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bffbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.428572:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574332.428577:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bffbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.428585:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bffbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.428602:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:1.0:1787574332.428605:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787574332.428610:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bffbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.428617:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bffbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.428666:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bffb7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecb2 expref: 57 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.428685:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982a04da2c00) 00010000:00010000:1.0:1787574332.428688:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787574332.428693:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bffb7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecb2 expref: 57 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.428702:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0400, rc 0) 00000100:00100000:1.0:1787574332.428826:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+56:10544:x1874407272273664:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 961us (1154us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1787574332.428835:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:2.0:1787574332.439705:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574332.440554:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272273792 00000100:00100000:3.0:1787574332.440569:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272273792 00000100:00100000:3.0:1787574332.440677:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:3.0:1787574332.440689:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+56:10544:x1874407272273792:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787574332.440733:0:5831:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787574332.440866:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+56:10544:x1874407272273792:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 179us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574332.440875:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:2.0:1787574332.448158:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574332.448733:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272274048 00000100:00100000:1.0:1787574332.448750:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272274048 00000100:00100000:1.0:1787574332.448842:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:1.0:1787574332.448854:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0355ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+56:10544:x1874407272274048:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787574332.448881:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574332.448885:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787574332.448919:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646bff5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec96 expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.448945:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:1.0:1787574332.448951:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787574332.448978:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bffcc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ecb9 expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787574332.449841:0:7646:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1787574332.450605:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bffd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.450648:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bffd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.450662:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bffd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.450765:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bffcc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecb9 expref: 58 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.450787:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bffd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecb9 expref: 57 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.450797:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982a04da2400) 00010000:00010000:1.0:1787574332.450801:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787574332.450804:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0600, rc 0) 00000100:00100000:1.0:1787574332.450889:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0355ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+57:10544:x1874407272274048:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 2037us (2744us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1787574332.450898:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:2.0:1787574332.458661:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574332.459805:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272274304 00000100:00100000:0.0:1787574332.459818:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272274304 00000100:00100000:0.0:1787574332.459894:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:0.0:1787574332.459905:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+57:10544:x1874407272274304:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787574332.460115:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574332.460143:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646bffd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecb9 expref: 57 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.460252:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982a04da2400) 00010000:00010000:0.0:1787574332.460264:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574332.460285:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01800/0xfe91058e646bffe1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.460319:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01800/0xfe91058e646bffe1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.460329:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01800/0xfe91058e646bffe1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.460357:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bffe8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x6c4a6fb9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.460365:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bffe8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6c4a6fb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.460372:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bffe8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6c4a6fb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.460452:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01800/0xfe91058e646bffe1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.460459:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01800/0xfe91058e646bffe1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.460466:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01800/0xfe91058e646bffe1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.460472:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01800 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574332.460477:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01800/0xfe91058e646bffe1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.460485:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01800/0xfe91058e646bffe1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.460493:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:0.0:1787574332.460501:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574332.460505:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01800/0xfe91058e646bffe1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.460511:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01800/0xfe91058e646bffe1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.460522:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bffe8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6c4a6fb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.460528:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bffe8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6c4a6fb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.460534:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bffe8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6c4a6fb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.460538:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574332.460600:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bffe8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6c4a6fb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.460607:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bffe8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6c4a6fb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.460615:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x6c4a6fb9 (ffff982a0de1db00) 00010000:00010000:0.0:1787574332.460618:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574332.460621:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bffe8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6c4a6fb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.460627:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646bffe8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6c4a6fb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574332.460715:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+56:10544:x1874407272274304:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 811us (2063us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787574332.460730:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:3.0:1787574332.462827:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574332.462941:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272274432 00000100:00100000:1.0:1787574332.462951:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272274432 00000100:00100000:1.0:1787574332.463005:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:1.0:1787574332.463014:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+56:10544:x1874407272274432:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787574332.463032:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574332.463052:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bffef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ecc0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.463082:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646bfff6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.463116:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646bfff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.463126:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646bfff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.463340:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bffef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecc0 expref: 58 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.463367:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646bfff6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecc0 expref: 57 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.463375:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982a04da2900) 00010000:00010000:1.0:1787574332.463377:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787574332.463380:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0e00, rc 0) 00000100:00100000:1.0:1787574332.463562:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+57:10544:x1874407272274432:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 547us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574332.463569:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:3.0:1787574332.484758:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574332.486665:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272274688 00000100:00100000:1.0:1787574332.486677:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272274688 00000100:00100000:1.0:1787574332.486782:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:1.0:1787574332.486792:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+57:10544:x1874407272274688:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787574332.486861:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfffd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.486877:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfffd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.486908:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfffd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787574332.487195:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1787574332.487205:0:5831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 308662039188ns, next at 309662036882ns, rc = 0 00000004:00010000:1.0:1787574332.487291:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067d0958d reply state 00000000b2960970 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfffd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574332.487301:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787574332.487419:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+59:10544:x1874407272274688:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 627us (2669us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1787574332.487426:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 119 00010000:00010000:1.0:1787574332.492225:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfffd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.492462:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfffd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.492472:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfffd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.492480:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574332.492486:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfffd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.492494:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfffd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.492516:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982a04da2900) 00010000:00010000:1.0:1787574332.492520:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787574332.492542:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfffd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.492549:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646bfffd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574332.493688:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574332.494138:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272274816 00000100:00100000:1.0:1787574332.494152:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272274816 00000100:00100000:1.0:1787574332.494496:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:1.0:1787574332.494509:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+58:10544:x1874407272274816:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787574332.494541:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574332.494576:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0004 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ecc7 expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.494654:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0004 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecc7 expref: 59 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.494671:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0004 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecc7 expref: 59 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.494700:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982a04da2900) 00010000:00010000:1.0:1787574332.494704:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787574332.494708:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1e00, rc 0) 00000100:00100000:1.0:1787574332.494801:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+59:10544:x1874407272274816:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 294us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574332.494810:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:3.0:1787574332.497904:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574332.497990:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272274944 00000100:00100000:1.0:1787574332.498027:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272274944 00000100:00100000:1.0:1787574332.498202:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:1.0:1787574332.498229:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2350:x1874407272274944:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787574332.498593:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:2350:x1874407272274944:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 364us (702us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787574332.498602:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:0.0:1787574332.502529:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574332.502628:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272275200 00000100:00100000:3.0:1787574332.502642:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272275200 00000100:00100000:3.0:1787574332.502714:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:3.0:1787574332.502726:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+59:10544:x1874407272275200:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787574332.503032:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+60:10544:x1874407272275200:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 307us (515us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1787574332.503059:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:3.0:1787574332.508193:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574332.508385:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272275456 00000100:00100000:0.0:1787574332.508398:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272275456 00000100:00100000:0.0:1787574332.508480:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:0.0:1787574332.508492:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+60:10544:x1874407272275456:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787574332.508639:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+60:10544:x1874407272275456:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 149us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574332.508647:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:0.0:1787574332.511355:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574332.511483:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272275584 00000100:00100000:3.0:1787574332.511496:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272275584 00000100:00100000:3.0:1787574332.511620:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 122 00000100:00100000:3.0:1787574332.511632:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+60:10544:x1874407272275584:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574332.511658:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574332.511685:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c000b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ecce expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.511788:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c0012 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.511806:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c0012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.511819:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c0012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574332.511864:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787574332.511886:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c0012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.511919:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c000b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecce expref: 62 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.511942:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c0012 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecce expref: 61 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.511974:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982a04da2900) 00010000:00010000:3.0:1787574332.511978:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787574332.511982:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142000, rc 0) 00000100:00100000:3.0:1787574332.512861:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+61:10544:x1874407272275584:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 965us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574332.512873:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 122 00000100:00100000:2.0:1787574332.517208:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574332.517297:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272275712 00000100:00100000:3.0:1787574332.517311:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272275712 00000100:00100000:3.0:1787574332.517382:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:3.0:1787574332.517396:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:2352:x1874407272275712:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574332.517420:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574332.517535:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000048c125c/0xfe91058e646c0019 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ecd5 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787574332.517571:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c383c, blocks: 0x1 00010000:00010000:3.0:1787574332.517594:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=308s v=(0 0) 00010000:00010000:3.0:1787574332.517600:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574332.517613:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000048c125c/0xfe91058e646c0019 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecd5 expref: 10 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.517634:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000048c125c/0xfe91058e646c0019 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecd5 expref: 10 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.517652:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142600, rc 0) 00000100:00100000:3.0:1787574332.517751:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+10:2352:x1874407272275712:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 358us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574332.517759:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:2.0:1787574332.523668:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574332.523793:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272275968 00000100:00100000:0.0:1787574332.523805:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272275968 00000100:00100000:0.0:1787574332.523874:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:0.0:1787574332.523885:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+61:10544:x1874407272275968:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787574332.525821:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+61:10544:x1874407272275968:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 1923us (2152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574332.525836:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:0.0:1787574332.533965:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574332.534345:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272276096 00000100:00100000:2.0:1787574332.534359:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272276096 00000100:00100000:2.0:1787574332.534533:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:2.0:1787574332.534549:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+10:10544:x1874407272276096:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787574332.534572:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574332.534598:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005062ef44/0xfe91058e646c0020 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ecdc expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574332.534655:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000048c125c/0xfe91058e646c0019 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecd5 expref: 11 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574332.534666:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574332.534670:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574332.534677:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005062ef44/0xfe91058e646c0020 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecdc expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574332.534719:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000048c125c/0xfe91058e646c0019 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecd5 expref: 11 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574332.534734:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000048c125c/0xfe91058e646c0019 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecd5 expref: 11 pid: 6683 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574332.534749:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11be0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1874407290112384:192.168.206.51@tcp:104: 00000100:00100000:2.0:1787574332.535268:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3a6c3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787574332.540799:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574332.541011:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11be0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1874407290112384:192.168.206.51@tcp:104: 00010000:00010000:3.0:1787574332.541064:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005062ef44/0xfe91058e646c0020 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecdc expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.541103:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fb200, rc 0) 00000100:00100000:3.0:1787574332.541224:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+11:10544:x1874407272276096:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 6680us (7273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574332.541236:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:0.0:1787574332.541403:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272276224 00000100:00100000:0.0:1787574332.541414:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272276224 00010000:00010000:0.0:1787574332.541568:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000048c125c/0xfe91058e646c0019 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecd5 expref: 11 pid: 6683 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574332.541611:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:0.0:1787574332.541623:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+11:2350:x1874407272276224:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574332.541659:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574332.541690:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000048c125c/0xfe91058e646c0019 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecd5 expref: 11 pid: 6683 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.541706:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000048c125c/0xfe91058e646c0019 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecd5 expref: 11 pid: 6683 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.541733:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000048c125c/0xfe91058e646c0019 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecd5 expref: 11 pid: 6683 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.541749:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574332.541755:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574332.541764:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005062ef44/0xfe91058e646c0020 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecdc expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.541776:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005062ef44/0xfe91058e646c0020 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecdc expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.541819:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005062ef44/0xfe91058e646c0020 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecdc expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574332.541834:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41890a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5816:1874407290112512:192.168.206.51@tcp:105: 00000100:00100000:0.0:1787574332.541915:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574332.547595:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574332.547758:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272276352 00000100:00100000:3.0:1787574332.547770:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272276352 00002000:00100000:3.0:1787574332.547835:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff982a11be1c00 x1874407272276352/t0(0) o4->a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp:103/0 lens 504/0 e 0 to 0 dl 1787574343 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787574332.547849:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a11be1c00 with x1874407272276352 ext(0->12) 00002000:00010000:3.0:1787574332.547856:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff982a11be1c00 00000100:00100000:3.0:1787574332.547900:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:3.0:1787574332.547911:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+11:2351:x1874407272276352:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787574332.548493:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+13:2351:x1874407272276352:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 582us (911us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787574332.548502:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00002000:00100000:3.0:1787574332.548511:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff982a11be1c00 x1874407272276352/t4294967308(0) o4->a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp:103/0 lens 504/448 e 0 to 0 dl 1787574343 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787574332.548532:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a11be1c00 with x1874407272276352 ext(0->12) 00002000:00010000:3.0:1787574332.548537:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff982a11be1c00 00000100:00100000:0.0:1787574332.551005:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41890a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5816:1874407290112512:192.168.206.51@tcp:105: 00010000:00010000:0.0:1787574332.551040:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574332.555424:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+12:2350:x1874407272276224:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 13784us (14621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574332.555444:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:3.0:1787574332.555714:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574332.556297:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272276480 00000100:00100000:1.0:1787574332.556310:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272276480 00000100:00100000:1.0:1787574332.556386:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 124 00000100:00100000:1.0:1787574332.556398:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+61:10544:x1874407272276480:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787574332.616422:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967376 is committed 00000004:00080000:0.0:1787574332.616447:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:0.0:1787574332.616710:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:0.0:1787574332.616715:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1787574332.616735:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1787574332.616761:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff982a056a99c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787574332.616768:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982a4145f700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff982a09a3c600 00000020:00080000:0.0:1787574332.616772:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982a4145f300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff982a3a8b6400 00000020:00080000:0.0:1787574332.616811:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff982906a61000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787574332.616814:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982a4145fb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff982906a61f00 00000020:00080000:0.0:1787574332.616817:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982a4145ff00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff982a3a662000 00000001:00080000:0.0:1787574332.616832:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:0.0:1787574332.616859:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1787574332.617035:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787574332.617453:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787574332.617466:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574332.617607:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a418f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290112896:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787574332.617696:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574332.617778:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574332.617832:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290112896 00000100:00100000:3.0:1787574332.617842:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290112896 00000100:00100000:3.0:1787574332.617913:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787574332.617925:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3299:x1874407290112896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787574332.617973:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1787574332.618016:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8c383b, atime: 0x6a8c383b, ctime: 0x6a8c383b, blocks: 0x1 00010000:00010000:3.0:1787574332.618027:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0027 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.618047:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=308s v=(0 0) 00010000:00010000:3.0:1787574332.618053:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574332.618061:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0027 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.618080:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0027 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.618102:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0027 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.618111:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0027 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.618161:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787574332.618660:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+15:10544:x1874407272276480:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 62258us (62941us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574332.618673:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 124 00010000:00010000:2.0:1787574332.618713:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574332.618721:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0027 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574332.618747:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16143a00 already unused, calling callback (ffffffffc142f230) 00000100:00100000:3.0:1787574332.618748:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3299:x1874407290112896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 824us (1050us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787574332.618758:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1787574332.618766:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0027 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574332.618779:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0027 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574332.618803:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0027 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574332.618811:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0027 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574332.618911:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290112640:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787574332.618955:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574332.618958:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574332.618960:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574332.622696:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574332.622811:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272276608 00000100:00100000:2.0:1787574332.622834:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272276608 00000100:00100000:2.0:1787574332.622914:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:2.0:1787574332.622926:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+12:2350:x1874407272276608:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787574332.625262:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290112768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787574332.625356:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787574332.625454:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982a418f9f80/2, rc 0, transno 4294967304 00000100:00100000:1.0:1787574332.625461:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a418f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290112896:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1787574332.625502:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787574332.625639:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290112768 00000100:00100000:3.0:1787574332.625648:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290112768 00000100:00100000:3.0:1787574332.625715:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787574332.625725:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1874407290112768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787574332.625919:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787574332.625923:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787574332 00002000:00010000:3.0:1787574332.625926:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787574332.625928:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787574332 -> 1787574332 00002000:00010000:3.0:1787574332.625930:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787574332.625983:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3299:x1874407290112768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 259us (626us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787574332.625990:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:2.0:1787574332.626223:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982a41893480/2, rc 0, transno 4294967309 00000100:00100000:2.0:1787574332.626231:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290112768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787574332.630889:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574332.630958:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290112640 00000100:00100000:0.0:1787574332.630969:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290112640 00000100:00100000:0.0:1787574332.631033:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787574332.631046:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1874407290112640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787574332.631086:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1787574332.631132:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000574428f4/0xfe91058e646c002e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.631390:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5451310/0xfe91058e646bfde9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec3b expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.631412:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787574332.631417:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787574332.631423:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000574428f4/0xfe91058e646c002e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.631471:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d5451310/0xfe91058e646bfde9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec3b expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.631669:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d5451310/0xfe91058e646bfde9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec3b expref: 12 pid: 6681 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574332.631689:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41892680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1874407290113024:192.168.206.51@tcp:104: 00000100:00100000:0.0:1787574332.631796:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787574332.640412:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41892680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1874407290113024:192.168.206.51@tcp:104: 00010000:00010000:0.0:1787574332.640451:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000574428f4/0xfe91058e646c002e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574332.642713:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574332.643218:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272276736 00000100:00100000:2.0:1787574332.643231:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272276736 00010000:00010000:2.0:1787574332.643284:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d5451310/0xfe91058e646bfde9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec3b expref: 13 pid: 6681 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574332.643389:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:2.0:1787574332.643401:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+13:2350:x1874407272276736:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574332.643420:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574332.643427:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d5451310/0xfe91058e646bfde9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec3b expref: 13 pid: 6681 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574332.643443:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d5451310/0xfe91058e646bfde9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec3b expref: 13 pid: 6681 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574332.643470:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5451310/0xfe91058e646bfde9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec3b expref: 13 pid: 6681 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574332.643487:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574332.643492:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574332.643499:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000574428f4/0xfe91058e646c002e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574332.643510:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000574428f4/0xfe91058e646c002e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574332.643548:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574332.643626:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+12:2350:x1874407272276736:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 227us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574332.643635:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 57 00010000:00010000:2.0:1787574332.647496:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000574428f4/0xfe91058e646c002e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574332.647521:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000574428f4/0xfe91058e646c002e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574332.647535:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000574428f4/0xfe91058e646c002e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574332.647543:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000574428f4/0xfe91058e646c002e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574332.647679:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574332.648434:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574332.648445:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000574428f4/0xfe91058e646c002e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.648458:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00400 already unused, calling callback (ffffffffc142f230) 00010000:00010000:3.0:1787574332.648463:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000574428f4/0xfe91058e646c002e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.648487:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000574428f4/0xfe91058e646c002e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574332.648739:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3300:x1874407290112640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17691us (17856us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787574332.648751:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:3.0:1787574332.648815:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000574428f4/0xfe91058e646c002e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.648962:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000574428f4/0xfe91058e646c002e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.648990:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574332.648992:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574332.648995:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787574332.649895:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982a41890a80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787574332.649911:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290112640:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1787574332.684609:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1787574332.684653:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1787574332.684660:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1787574332.688328:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2350:x1874407272276608:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 65387us (65629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574332.688345:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:2.0:1787574332.695970:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574332.696100:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272276992 00000100:00100000:3.0:1787574332.696113:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272276992 00000100:00100000:3.0:1787574332.696213:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00100000:3.0:1787574332.696225:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+15:10544:x1874407272276992:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787574332.696295:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574332.696327:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c0012 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecce expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.696352:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982a04da2900) 00010000:00010000:3.0:1787574332.696358:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574332.696410:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c0035 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.696426:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c0035 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.696438:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c0035 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787574332.696892:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000263d9076 reply state 00000000858cc965 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c0035 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574332.696906:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787574332.697031:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+16:10544:x1874407272276992:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 807us (1073us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787574332.697038:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 125 00010000:00010000:1.0:1787574332.698890:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c0035 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.698909:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c0035 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.698918:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c0035 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.698941:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16143000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574332.698947:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c0035 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.698955:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c0035 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.698976:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982a04da2900) 00010000:00010000:1.0:1787574332.698980:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574332.698985:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c0035 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.698991:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c0035 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574332.701677:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574332.702780:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272277120 00000100:00100000:1.0:1787574332.702797:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272277120 00000100:00100000:1.0:1787574332.702874:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:1.0:1787574332.702888:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2350:x1874407272277120:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787574332.703424:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787574332.703430:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787574332 -> 1787574331 00002000:00010000:1.0:1787574332.703432:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787574331 00002000:00010000:1.0:1787574332.703434:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787574332 -> 1787574331 00002000:00010000:1.0:1787574332.703436:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787574332.703593:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2350:x1874407272277120:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 705us (1927us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787574332.703603:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:2.0:1787574332.716695:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574332.716854:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272277376 00000100:00100000:3.0:1787574332.716867:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272277376 00000100:00100000:3.0:1787574332.721733:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 126 00000100:00100000:3.0:1787574332.721831:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+15:10544:x1874407272277376:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787574332.721927:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c003c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.722054:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646bfff6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecc0 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.722066:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c003c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.722129:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646bfff6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecc0 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.722189:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646bfff6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecc0 expref: 15 pid: 5830 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574332.722274:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a418fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874407290113152:192.168.206.51@tcp:104: 00000100:00100000:3.0:1787574332.722409:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0828c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574332.725754:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574332.725850:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272277504 00000100:00100000:0.0:1787574332.725875:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272277504 00010000:00010000:0.0:1787574332.725930:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646bfff6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecc0 expref: 16 pid: 5830 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574332.725976:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:0.0:1787574332.725987:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+16:2351:x1874407272277504:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574332.726005:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574332.726012:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646bfff6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecc0 expref: 16 pid: 5830 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.726028:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646bfff6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecc0 expref: 16 pid: 5830 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.726056:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982a04da2900) 00010000:00010000:0.0:1787574332.726063:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c003c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.726074:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c003c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.726083:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c003c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.726117:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574332.726209:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+16:2351:x1874407272277504:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 223us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574332.726218:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 58 00010000:00010000:3.0:1787574332.728261:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646bfff6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecc0 expref: 15 pid: 5830 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574332.728289:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a418fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874407290113152:192.168.206.51@tcp:104: 00010000:00010000:3.0:1787574332.728318:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c003c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.728328:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c003c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.728334:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c003c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.728372:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c003c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.728380:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c003c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.728388:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c003c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.728394:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574332.728422:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c003c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.728430:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c003c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.728449:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982a04da2900) 00010000:00010000:3.0:1787574332.728453:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787574332.728458:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c003c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.728464:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c003c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574332.728558:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+14:10544:x1874407272277376:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 6808us (11878us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787574332.728579:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 126 00000100:00100000:3.0:1787574332.732395:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574332.732587:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272277632 00000100:00100000:1.0:1787574332.732616:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272277632 00000100:00100000:1.0:1787574332.732687:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:1.0:1787574332.732699:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2351:x1874407272277632:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787574332.732757:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000217b57fa/0xfe91058e646c0043 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.732782:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005062ef44/0xfe91058e646c0020 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecdc expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.732792:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574332.732798:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787574332.732803:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000217b57fa/0xfe91058e646c0043 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.732848:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005062ef44/0xfe91058e646c0020 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecdc expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.732864:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005062ef44/0xfe91058e646c0020 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecdc expref: 7 pid: 6681 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574332.732882:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11bb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1874407290113280:192.168.206.51@tcp:104: 00000100:00100000:1.0:1787574332.733044:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056a9480 going to sleep for 11 seconds 00000100:00100000:1.0:1787574332.737155:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11bb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1874407290113280:192.168.206.51@tcp:104: 00010000:00010000:1.0:1787574332.737287:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000217b57fa/0xfe91058e646c0043 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574332.738416:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574332.738526:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272277760 00000100:00100000:2.0:1787574332.738538:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272277760 00010000:00010000:2.0:1787574332.738602:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005062ef44/0xfe91058e646c0020 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecdc expref: 8 pid: 6681 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574332.738653:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:2.0:1787574332.738665:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41dbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2351:x1874407272277760:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574332.738698:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574332.738727:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005062ef44/0xfe91058e646c0020 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecdc expref: 8 pid: 6681 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574332.738743:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005062ef44/0xfe91058e646c0020 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecdc expref: 8 pid: 6681 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574332.738777:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005062ef44/0xfe91058e646c0020 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecdc expref: 8 pid: 6681 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574332.738795:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574332.738800:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574332.738806:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000217b57fa/0xfe91058e646c0043 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574332.738818:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000217b57fa/0xfe91058e646c0043 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574332.738857:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574332.738922:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41dbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2351:x1874407272277760:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 259us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574332.738930:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 59 00010000:00010000:3.0:1787574332.739597:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000217b57fa/0xfe91058e646c0043 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.739610:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000217b57fa/0xfe91058e646c0043 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.739641:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000217b57fa/0xfe91058e646c0043 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.739649:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000217b57fa/0xfe91058e646c0043 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.739668:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000217b57fa/0xfe91058e646c0043 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.739676:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0400 already unused, calling callback (ffffffffc142f230) 00010000:00010000:3.0:1787574332.739681:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000217b57fa/0xfe91058e646c0043 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.739691:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000217b57fa/0xfe91058e646c0043 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.739706:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000217b57fa/0xfe91058e646c0043 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.739713:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000217b57fa/0xfe91058e646c0043 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574332.739802:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2351:x1874407272277632:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 7102us (7417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574332.739812:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:3.0:1787574332.743107:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574332.743553:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272278016 00000100:00100000:0.0:1787574332.743577:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272278016 00000100:00100000:1.0:1787574332.743903:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 127 00000100:00100000:1.0:1787574332.743917:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41db8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+14:10544:x1874407272278016:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787574332.744018:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c004a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.744041:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c004a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.744055:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c004a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.744471:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646c0051 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.744483:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0004 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecc7 expref: 15 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.744492:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646c0051 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.744536:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0004 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecc7 expref: 15 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.744552:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0004 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecc7 expref: 15 pid: 7646 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574332.744685:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11bb4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874407290113408:192.168.206.51@tcp:104: 00000100:00100000:1.0:1787574332.744858:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056a9480 going to sleep for 11 seconds 00000100:00100000:2.0:1787574332.749379:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574332.749379:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11bb4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874407290113408:192.168.206.51@tcp:104: 00010000:00010000:1.0:1787574332.749426:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646c0051 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574332.749531:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272278144 00000100:00100000:0.0:1787574332.749541:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272278144 00010000:00010000:0.0:1787574332.749679:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0004 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecc7 expref: 16 pid: 7646 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574332.749725:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:0.0:1787574332.749737:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+16:2351:x1874407272278144:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574332.749757:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574332.749765:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0004 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecc7 expref: 16 pid: 7646 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.749779:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0004 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecc7 expref: 16 pid: 7646 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.749806:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0004 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecc7 expref: 16 pid: 7646 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.749824:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982a04da2900) 00010000:00010000:0.0:1787574332.749830:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646c0051 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.749841:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646c0051 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.749849:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646c0051 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.749881:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574332.749988:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+15:2351:x1874407272278144:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 252us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574332.750014:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 60 00010000:00010000:1.0:1787574332.750078:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646c0051 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.750084:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646c0051 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787574332.750371:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1787574332.750784:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1787574332.750834:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1787574332.750935:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11bb4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1874407290113536:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787574332.751000:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574332.751119:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a26fc6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574332.751403:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290113536 00000100:00100000:0.0:1787574332.751410:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290113536 00000100:00100000:0.0:1787574332.751459:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787574332.751470:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1874407290113536:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787574332.751682:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1874407290113536:12345-0@lo:1000:mdt00_002.0 Request processed in 213us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574332.751690:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787574332.751759:0:5832:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1787574332.751766:0:5832:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1787574332.751791:0:5832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982a41893480, transno 4294967309 00000100:00100000:1.0:1787574332.751814:0:5832:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff982a41890a80 x1874407290112640/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787574348 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574332.751827:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11bb4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1874407290113536:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787574332.752338:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1787574332.752409:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11bb4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1874407290113664:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787574332.752452:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574332.752485:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a26fc6240 going to sleep for 11 seconds 00000100:00100000:3.0:1787574332.752583:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290113664 00000100:00100000:3.0:1787574332.752590:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290113664 00000100:00100000:3.0:1787574332.752633:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787574332.752643:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5832:x1874407290113664:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787574332.752844:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5832:x1874407290113664:12345-0@lo:1000:mdt00_002.0 Request processed in 202us (390us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787574332.752859:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787574332.752930:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11bb4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1874407290113664:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787574332.752974:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646c0051 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.752985:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646c0051 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.752994:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646c0051 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.753001:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0800 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574332.753007:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646c0051 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.753016:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646c0051 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.753035:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982a04da2900) 00010000:00010000:1.0:1787574332.753038:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787574332.753044:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646c0051 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.753051:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646c0051 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.753099:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646bff94 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.753108:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646bff94 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.753113:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646bff94 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.753127:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fa000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574332.753130:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646bff94 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.753135:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646bff94 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.753273:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:1.0:1787574332.753276:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787574332.753284:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00a00/0xfe91058e646bff9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecab expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.753296:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00a00/0xfe91058e646bff9b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecab expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.753305:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00a00/0xfe91058e646bff9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecab expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.753338:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00a00/0xfe91058e646bff9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecab expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574332.753350:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11bb5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874407290113792:192.168.206.51@tcp:105: 00000100:00100000:1.0:1787574332.753430:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a26fc6240 going to sleep for 11 seconds 00000100:00100000:1.0:1787574332.758054:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11bb5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874407290113792:192.168.206.51@tcp:105: 00010000:00010000:1.0:1787574332.758112:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646bff94 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.758144:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646bff94 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.758228:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0058 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.758244:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0058 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.758260:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0058 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.758274:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0058 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.758281:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0058 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.758288:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0058 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.758294:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574332.758299:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0058 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.758308:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0058 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.758322:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:1.0:1787574332.758325:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574332.758329:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0058 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.758342:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0058 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.758353:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c004a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.758359:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c004a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.758366:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c004a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.758371:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574332.758374:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c004a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.758380:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c004a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.758388:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:1.0:1787574332.758390:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787574332.758392:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c004a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.758397:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c004a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574332.758684:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41db8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+18:10544:x1874407272278016:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 14767us (15598us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1787574332.758695:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 127 00000020:00080000:1.0:1787574332.758708:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787574332.759850:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787574332.759861:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787574332.760413:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787574332.760424:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787574332.761030:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574332.761080:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272278272 00000100:00100000:3.0:1787574332.761104:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272278272 00000100:00100000:0.0:1787574332.761137:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574332.761255:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272278528 00000100:00100000:3.0:1787574332.761260:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272278528 00000100:00100000:3.0:1787574332.761283:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:3.0:1787574332.761294:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:10542:x1874407272278272:12345-192.168.206.51@tcp:49:lfs.0 00000100:00100000:3.0:1787574332.761474:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:10542:x1874407272278272:12345-192.168.206.51@tcp:49:lfs.0 Request processed in 181us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574332.761483:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:3.0:1787574332.761503:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:3.0:1787574332.761510:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a03537850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+18:10544:x1874407272278528:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787574332.762332:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787574332.762451:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1787574332.762504:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c005f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.762523:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c005f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.762537:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c005f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.762547:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c005f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.762563:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c005f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.762570:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c005f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.762647:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787574332.762688:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574332.762695:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c005f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.762702:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142000 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574332.762706:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c005f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.762715:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c005f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574332.762729:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982a04dc0f00) 00010000:00010000:1.0:1787574332.762733:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:3.0:1787574332.762734:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a03537850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+20:10544:x1874407272278528:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 1221us (1593us total) trans 4294967408 rc 0/0 00010000:00010000:1.0:1787574332.762738:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c005f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574332.762742:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00010000:00010000:1.0:1787574332.762744:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c005f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787574332.762747:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787574332.762772:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574332.762774:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574332.762776:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574332.765044:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574332.765377:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272278784 00000100:00100000:2.0:1787574332.765389:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272278784 00000100:00100000:2.0:1787574332.765602:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 128 00000100:00100000:2.0:1787574332.765616:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+20:10542:x1874407272278784:12345-192.168.206.51@tcp:58:lfs.0 00000040:00080000:2.0:1787574332.765956:0:7646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787574332.766108:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+20:10542:x1874407272278784:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 494us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574332.766116:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 128 00000100:00100000:2.0:1787574332.792891:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574332.792987:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272278912 00000100:00100000:3.0:1787574332.793000:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272278912 00000100:00100000:3.0:1787574332.793078:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00100000:3.0:1787574332.793099:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+20:10546:x1874407272278912:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1787574332.793126:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574332.793163:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c0066 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ece3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.793357:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c006d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.793376:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c006d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.793389:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c006d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.793407:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0074 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.793414:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0074 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.793421:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0074 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.794113:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646c007b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.794139:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff86 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eca4 expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.794148:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646c007b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.794233:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eca4 expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.794251:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff86 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eca4 expref: 21 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574332.794267:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41890e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874407290113920:192.168.206.51@tcp:104: 00000100:00100000:0.0:1787574332.794417:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574332.798707:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41890e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874407290113920:192.168.206.51@tcp:104: 00010000:00010000:1.0:1787574332.798750:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646c007b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574332.799413:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574332.799501:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272279168 00000100:00100000:1.0:1787574332.799511:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272279168 00000100:00100000:1.0:1787574332.799580:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:1.0:1787574332.799593:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+22:5588:x1874407272279168:12345-192.168.206.51@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787574332.799914:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+23:5588:x1874407272279168:12345-192.168.206.51@tcp:35:ldlm_bl.0 Request processed in 322us (504us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1787574332.799922:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:2.0:1787574332.804785:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574332.805336:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272279296 00000100:00100000:3.0:1787574332.805350:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272279296 00010000:00010000:3.0:1787574332.805406:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff86 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eca4 expref: 23 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574332.805457:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:3.0:1787574332.805468:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a063ab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+23:2351:x1874407272279296:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574332.805493:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574332.805517:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff86 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eca4 expref: 23 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.805532:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eca4 expref: 23 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.805560:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646bff86 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eca4 expref: 23 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.805581:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:3.0:1787574332.805587:0:8453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646c007b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.805597:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646c007b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.805607:0:8453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646c007b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574332.805648:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574332.805726:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a063ab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+22:2351:x1874407272279296:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 259us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574332.805734:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 61 00010000:00010000:0.0:1787574332.806109:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646c007b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.806119:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646c007b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574332.806214:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787574332.806219:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787574332.806244:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646c007b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.806260:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646c007b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.806271:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c006d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.806288:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c006d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.806295:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c006d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.806302:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574332.806307:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c006d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.806314:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c006d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.806326:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:0.0:1787574332.806329:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574332.806334:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c006d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.806339:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c006d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.806351:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0074 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.806357:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0074 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.806364:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0074 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.806369:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574332.806377:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0074 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.806382:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0074 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.806389:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982a0de1db00) 00010000:00010000:0.0:1787574332.806391:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574332.806394:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0074 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.806400:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0074 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.806443:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c0066 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ece3 expref: 22 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.806462:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646c007b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ece3 expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574332.806470:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:0.0:1787574332.806472:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574332.806475:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a41d01600, rc 0) 00000100:00100000:0.0:1787574332.806536:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+21:10546:x1874407272278912:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 13448us (13659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574332.806545:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 129 00000001:00080000:0.0:1787574333.137945:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1787574333.137981:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:3.0:1787574333.169466:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787574333.764476:0:12056:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787574333.764489:0:12056:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787574333.764544:0:12056:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787574333.764551:0:12056:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787574333.810495:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787574333.810505:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787574333.813059:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787574333.813077:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787574333.813309:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11bb5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874407290114048:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787574333.813438:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056a9180 going to sleep for 11 seconds 00000100:00100000:3.0:1787574333.816896:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11bb5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874407290114048:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787574333.820743:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574333.821376:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272279424 00000100:00100000:3.0:1787574333.821412:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272279424 00000100:00100000:3.0:1787574333.822536:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 130 00000100:00100000:3.0:1787574333.822561:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+21:10558:x1874407272279424:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787574333.822615:0:5830:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787574333.822793:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+21:10558:x1874407272279424:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 241us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574333.822802:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 130 00000100:00080000:1.0:1787574333.822871:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574333.834361:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574333.834413:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272279680 00000100:00100000:3.0:1787574333.834426:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272279680 00000100:00100000:3.0:1787574333.834524:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 131 00000100:00100000:3.0:1787574333.834537:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+21:10558:x1874407272279680:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574333.834568:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574333.834598:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c0082 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ecea expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574333.834767:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0089 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574333.834786:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0089 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574333.834805:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0089 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574333.834820:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787574333.834992:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c0082 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecea expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574333.835012:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0089 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecea expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574333.835033:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:3.0:1787574333.835036:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574333.835040:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16143800, rc 0) 00000100:00100000:3.0:1787574333.835145:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+23:10558:x1874407272279680:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 609us (796us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1787574333.835155:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 131 00000100:00100000:0.0:1787574333.839917:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574333.840000:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272279808 00000100:00100000:1.0:1787574333.840016:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272279808 00000100:00100000:1.0:1787574333.840111:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:1.0:1787574333.840125:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41891f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+23:2350:x1874407272279808:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574333.840144:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574333.840202:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0089 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecea expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574333.840226:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:1.0:1787574333.840232:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574333.840312:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41891f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+22:2350:x1874407272279808:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 190us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574333.840320:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:1.0:1787574333.844223:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574333.844626:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272280064 00000100:00100000:0.0:1787574333.844656:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272280064 00000100:00100000:0.0:1787574333.844726:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 132 00000100:00100000:0.0:1787574333.844739:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+22:10558:x1874407272280064:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787574333.844917:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c0097 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574333.844940:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c0097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574333.844954:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c0097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574333.845232:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c0097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574333.845241:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c0097 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574333.845248:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c0097 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574333.845255:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574333.845260:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c0097 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574333.845269:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c0097 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574333.845284:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:0.0:1787574333.845287:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787574333.845292:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c0097 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574333.845310:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c0097 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787574333.846528:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787574333.846537:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787574333.847070:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787574333.847081:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787574333.850229:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+23:10558:x1874407272280064:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 5475us (6003us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787574333.850248:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 132 00000100:00100000:1.0:1787574333.853740:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574333.854519:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272280320 00000100:00100000:2.0:1787574333.854535:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272280320 00000100:00100000:2.0:1787574333.854623:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:2.0:1787574333.854636:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+23:10558:x1874407272280320:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787574333.854958:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+24:10558:x1874407272280320:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 323us (1232us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1787574333.854967:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00010000:00010000:1.0:1787574334.193389:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574335.217622:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574335.602287:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290114176:0@lo:400:kworker.0 00000100:00100000:0.0:1787574335.602382:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574335.602455:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574335.602462:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874407290114304:0@lo:400:kworker.0 00000100:00100000:0.0:1787574335.602493:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574335.602534:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290114304 00000100:00100000:0.0:1787574335.602543:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290114304 00000100:00100000:0.0:1787574335.602598:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787574335.602609:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874407290114304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574335.602672:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874407290114304:12345-0@lo:400:kworker.0 Request processed in 65us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574335.602681:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787574335.602732:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874407290114304:0@lo:400:kworker.0 00000100:00100000:3.0:1787574335.602842:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290114176 00000100:00100000:3.0:1787574335.602847:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290114176 00000100:00100000:3.0:1787574335.602883:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787574335.602891:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04964c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:3300:x1874407290114176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574335.602932:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04964c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:3300:x1874407290114176:12345-0@lo:400:kworker.0 Request processed in 42us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574335.602939:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787574335.603009:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290114176:0@lo:400:kworker.0 00000100:00100000:2.0:1787574335.608975:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290114432:0@lo:400:kworker.0 00000100:00100000:2.0:1787574335.609066:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574335.609126:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574335.609133:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290114560:0@lo:400:kworker.0 00000100:00100000:2.0:1787574335.609189:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574335.609223:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874407290114688:0@lo:400:kworker.0 00000100:00100000:2.0:1787574335.609249:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574335.609266:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574335.609272:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290114816:0@lo:400:kworker.0 00000100:00100000:2.0:1787574335.609308:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574335.609338:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290114432 00000100:00100000:2.0:1787574335.609348:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290114432 00000100:00100000:2.0:1787574335.609409:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290114688 00000100:00100000:2.0:1787574335.609412:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290114688 00000100:00100000:2.0:1787574335.609453:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787574335.609463:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290114432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574335.609523:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290114432:12345-0@lo:400:kworker.0 Request processed in 61us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574335.609531:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787574335.609551:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787574335.609558:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874407290114688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574335.609587:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874407290114688:12345-0@lo:400:kworker.0 Request processed in 30us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574335.609594:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787574335.609625:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290114560 00000100:00100000:2.0:1787574335.609628:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290114560 00000100:00100000:2.0:1787574335.609654:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290114816 00000100:00100000:2.0:1787574335.609657:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290114816 00000100:00100000:2.0:1787574335.609678:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787574335.609685:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3298:x1874407290114560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574335.609733:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3298:x1874407290114560:12345-0@lo:400:kworker.0 Request processed in 48us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574335.611139:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787574335.615871:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787574335.615906:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290114816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574335.616029:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290114816:12345-0@lo:400:kworker.0 Request processed in 141us (6719us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574335.616038:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787574335.616098:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787574335.616104:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787574335.616108:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1787574335.620109:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787574335.620121:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787574335.620192:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787574335.620199:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787574335.625981:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290114560:0@lo:400:kworker.0 00000100:00100000:2.0:1787574335.626003:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290114432:0@lo:400:kworker.0 00000100:00100000:2.0:1787574335.626071:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1787574335.626089:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:2.0:1787574335.626109:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982a3ad35f80, transno 4294967301 00000004:00080000:2.0:1787574335.626119:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1787574335.626133:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982a418f9f80, transno 4294967304 00000100:00100000:2.0:1787574335.626138:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290114816:0@lo:400:kworker.0 00000100:00100000:2.0:1787574335.626153:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874407290114688:0@lo:400:kworker.0 00000100:00100000:0.0:1787574335.791484:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574335.791699:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272280576 00000100:00100000:2.0:1787574335.791713:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272280576 00000100:00100000:2.0:1787574335.791819:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 133 00000100:00100000:2.0:1787574335.791832:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+24:10578:x1874407272280576:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1787574335.791863:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574335.791890:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c009e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ecf1 expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574335.792012:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb800/0xfe91058e646c00a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574335.792028:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb800/0xfe91058e646c00a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574335.792040:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb800/0xfe91058e646c00a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574335.792051:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787574335.792232:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c009e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecf1 expref: 27 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574335.792265:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb800/0xfe91058e646c00a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecf1 expref: 26 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574335.792275:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:2.0:1787574335.792278:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787574335.792283:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fb800, rc 0) 00000100:00100000:2.0:1787574335.792354:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+26:10578:x1874407272280576:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 524us (882us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1787574335.792361:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 133 00000100:00080000:3.0:1787574335.792432:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574335.797967:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574335.798064:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272280704 00000100:00100000:3.0:1787574335.798086:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272280704 00000100:00100000:3.0:1787574335.798154:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 134 00000100:00100000:3.0:1787574335.798370:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+26:10578:x1874407272280704:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:3.0:1787574335.798666:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c00b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574335.798689:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c00b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574335.798704:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c00b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574335.798812:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c00b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574335.798822:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c00b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574335.798829:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c00b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574335.798836:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16143a00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574335.798841:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c00b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574335.798851:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c00b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574335.798866:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:3.0:1787574335.798870:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787574335.798875:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c00b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574335.798882:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c00b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574335.799020:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+26:10578:x1874407272280704:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 855us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574335.799029:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 134 00000100:00100000:3.0:1787574335.862194:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574335.862737:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272280832 00000100:00100000:1.0:1787574335.862751:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272280832 00000100:00100000:1.0:1787574335.862837:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:1.0:1787574335.862850:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41dbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2350:x1874407272280832:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:1.0:1787574335.862872:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574335.862897:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd205865/0xfe91058e646c00ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ecf8 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787574335.862930:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8c383b, atime: 0x6a8c383b, ctime: 0x6a8c383b, blocks: 0xb 00010000:00010000:1.0:1787574335.862955:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=312s v=(0 0) 00010000:00010000:1.0:1787574335.862960:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574335.862971:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd205865/0xfe91058e646c00ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecf8 expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574335.863004:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fd205865/0xfe91058e646c00ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecf8 expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574335.863022:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1200, rc 0) 00000100:00100000:1.0:1787574335.863110:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41dbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2350:x1874407272280832:12345-192.168.206.51@tcp:101:cat.0 Request processed in 263us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574335.863118:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00080000:3.0:1787574335.863246:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574335.867384:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574335.867773:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272280960 00000100:00100000:0.0:1787574335.867787:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272280960 00002000:00100000:0.0:1787574335.867855:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff982a41890000 x1874407272280960/t0(0) o3->a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp:106/0 lens 488/0 e 0 to 0 dl 1787574346 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787574335.867866:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a41890000 with x1874407272280960 ext(0->4095) 00002000:00010000:0.0:1787574335.867873:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff982a41890000 00000100:00100000:0.0:1787574335.867903:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:0.0:1787574335.867913:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2353:x1874407272280960:12345-192.168.206.51@tcp:3:cat.0 00000100:00100000:0.0:1787574335.868200:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2353:x1874407272280960:12345-192.168.206.51@tcp:3:cat.0 Request processed in 287us (828us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787574335.868208:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00002000:00100000:0.0:1787574335.868214:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff982a41890000 x1874407272280960/t0(0) o3->a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp:106/0 lens 488/4536 e 0 to 0 dl 1787574346 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787574335.868222:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a41890000 with x1874407272280960 ext(0->4095) 00002000:00010000:0.0:1787574335.868225:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff982a41890000 00000100:00100000:0.0:1787574336.113876:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787574336.113904:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290114944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574336.113993:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574336.114084:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290114944 00000100:00100000:0.0:1787574336.114092:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290114944 00000100:00100000:0.0:1787574336.114148:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787574336.114159:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290114944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787574336.115644:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574336.115739:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290114944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1579us (1744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574336.115749:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787574336.116432:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290114944:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787574336.241464:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574336.800523:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574336.800603:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574336.800640:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574336.800663:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574336.800687:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574336.800720:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272281600 00000100:00100000:2.0:1787574336.800790:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272281600 00000100:00100000:2.0:1787574336.800959:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272281216 00000100:00100000:2.0:1787574336.800963:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272281216 00000100:00100000:2.0:1787574336.800990:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 137 00000100:00100000:2.0:1787574336.801001:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2352:x1874407272281600:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574336.801110:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2352:x1874407272281600:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 110us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574336.801209:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 137 00000100:00100000:2.0:1787574336.801247:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 138 00000100:00100000:2.0:1787574336.801254:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+26:2352:x1874407272281216:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574336.801282:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+26:2352:x1874407272281216:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 30us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574336.801288:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 138 00000100:00100000:2.0:1787574336.801314:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272281344 00000100:00100000:2.0:1787574336.801317:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272281344 00000100:00100000:2.0:1787574336.801343:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272281472 00000100:00100000:2.0:1787574336.801346:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272281472 00000100:00100000:2.0:1787574336.801366:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:2.0:1787574336.801373:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2352:x1874407272281344:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574336.801400:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2352:x1874407272281344:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 27us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574336.801406:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:2.0:1787574336.801417:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:2.0:1787574336.801423:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2352:x1874407272281472:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574336.801449:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2352:x1874407272281472:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 26us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574336.801455:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00080000:2.0:1787574336.801471:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787574336.801475:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574336.802365:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272281088 00000100:00100000:0.0:1787574336.802383:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272281088 00000100:00100000:0.0:1787574336.802433:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 289 00000100:00100000:0.0:1787574336.802442:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04967850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:2352:x1874407272281088:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574336.802497:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04967850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:2352:x1874407272281088:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 56us (1989us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574336.802504:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 289 00000100:00100000:3.0:1787574337.139479:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574337.139829:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290115072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574337.139922:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574337.141850:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290115072 00000100:00100000:0.0:1787574337.141866:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290115072 00000100:00100000:0.0:1787574337.141980:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787574337.141993:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41dbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1874407290115072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574337.142039:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574337.142130:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41dbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1874407290115072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (2208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574337.142138:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787574337.142235:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290115072:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787574337.142437:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787574337.266377:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787574337.731907:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1787574337.731933:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1787574337.731939:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1787574337.755876:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:2.0:1787574337.755897:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1787574337.755938:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff982a26fc6a80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787574337.755944:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982a4145f600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff982a26fc6180 00000020:00080000:2.0:1787574337.755948:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982a4145fa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff982a41c7b000 00000001:00080000:2.0:1787574337.755994:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1787574337.756056:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1787574337.756327:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1787574338.289562:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574339.313562:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574340.165399:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574340.165451:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272281728 00000100:00100000:0.0:1787574340.165464:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272281728 00000100:00100000:0.0:1787574340.165555:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 135 00000100:00100000:0.0:1787574340.165568:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+13:10231:x1874407272281728:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787574340.165698:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+13:10231:x1874407272281728:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 133us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574340.165723:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 135 00000100:00080000:2.0:1787574340.166711:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574340.167544:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574340.167639:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272281984 00000100:00100000:2.0:1787574340.167650:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272281984 00000100:00100000:2.0:1787574340.167768:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:2.0:1787574340.167779:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+13:10231:x1874407272281984:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787574340.168419:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+14:10231:x1874407272281984:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 639us (880us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1787574340.168429:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00010000:00010000:1.0:1787574340.339628:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574340.495545:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574340.498785:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272282112 00000100:00100000:2.0:1787574340.498809:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272282112 00000100:00100000:2.0:1787574340.498984:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 136 00000100:00100000:2.0:1787574340.498999:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+5:11030:x1874407272282112:12345-192.168.206.51@tcp:101:lsof.0 00010000:00010000:2.0:1787574340.499024:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574340.499064:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c00c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ecff expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574340.499187:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c00c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574340.499203:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c00c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574340.499217:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c00c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574340.499450:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787574340.499464:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787574340.499587:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c00c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574340.499625:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c00c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecff expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574340.499649:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c00c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecff expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574340.499675:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34300) 00010000:00010000:2.0:1787574340.499679:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787574340.499683:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fb600, rc 0) 00000100:00100000:2.0:1787574340.499794:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+6:11030:x1874407272282112:12345-192.168.206.51@tcp:101:lsof.0 Request processed in 798us (4262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574340.499804:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 136 00000100:00080000:3.0:1787574340.502997:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574340.722002:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290115584:0@lo:400:kworker.0 00000100:00100000:3.0:1787574340.722014:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290115456:0@lo:400:kworker.0 00000100:00100000:2.0:1787574340.722084:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290115200:0@lo:400:kworker.0 00000100:00100000:1.0:1787574340.722086:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874407290115328:0@lo:400:kworker.0 00000100:00100000:0.0:1787574340.729061:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574340.729199:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290115584 00000100:00100000:0.0:1787574340.729211:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290115584 00000100:00100000:0.0:1787574340.729281:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787574340.729291:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290115584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574340.729363:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290115584:12345-0@lo:400:kworker.0 Request processed in 73us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574340.729370:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1787574340.729398:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574340.729435:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1787574340.729441:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982a41890a80, transno 4294967310 00000004:00080000:0.0:1787574340.729452:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1787574340.729489:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290115584:0@lo:400:kworker.0 00000100:00100000:2.0:1787574340.733856:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574340.734010:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874407290115712:0@lo:400:kworker.0 00000100:00100000:2.0:1787574340.734078:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574340.734144:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290115712 00000100:00100000:2.0:1787574340.734153:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290115712 00000100:00100000:2.0:1787574340.734240:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787574340.734250:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874407290115712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574340.734313:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874407290115712:12345-0@lo:400:kworker.0 Request processed in 63us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574340.734320:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:2.0:1787574340.734361:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574340.734397:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874407290115712:0@lo:400:kworker.0 00000100:00100000:3.0:1787574340.736980:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574340.737288:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290115456 00000100:00100000:2.0:1787574340.737299:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290115456 00000100:00100000:1.0:1787574340.737495:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574340.737536:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290115840:0@lo:400:kworker.0 00000100:00100000:1.0:1787574340.737583:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574340.737621:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290115328 00000100:00100000:1.0:1787574340.737625:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290115328 00000100:00100000:1.0:1787574340.737677:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787574340.737688:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874407290115328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574340.737762:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874407290115328:12345-0@lo:400:kworker.0 Request processed in 76us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574340.737770:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787574340.737821:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874407290115328:0@lo:400:kworker.0 00000100:00100000:1.0:1787574340.737861:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290115840 00000100:00100000:1.0:1787574340.737879:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290115840 00000100:00100000:2.0:1787574340.738116:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787574340.738135:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290115456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574340.738210:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290115456:12345-0@lo:400:kworker.0 Request processed in 86us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574340.738217:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787574340.738261:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290115456:0@lo:400:kworker.0 00000100:00080000:3.0:1787574340.738702:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787574340.738718:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574340.738860:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787574340.738870:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290115840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574340.738925:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290115840:12345-0@lo:400:kworker.0 Request processed in 57us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574340.738931:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787574340.738969:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290115840:0@lo:400:kworker.0 00000100:00100000:0.0:1787574340.739233:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290115200 00000100:00100000:0.0:1787574340.739241:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290115200 00000100:00100000:0.0:1787574340.739285:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787574340.739293:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:3300:x1874407290115200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574340.739345:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:3300:x1874407290115200:12345-0@lo:400:kworker.0 Request processed in 52us (5500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574340.739351:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787574340.739414:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290115200:0@lo:400:kworker.0 00000100:00100000:1.0:1787574341.233720:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787574341.233753:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290115968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574341.233867:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574341.234158:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290115968 00000100:00100000:0.0:1787574341.234191:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290115968 00000100:00100000:0.0:1787574341.234263:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787574341.234287:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290115968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787574341.234331:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574341.234396:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290115968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574341.234404:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787574341.234517:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290115968:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787574341.361500:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574341.915992:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574341.916055:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574341.916101:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574341.916126:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272282624 00000100:00100000:0.0:1787574341.916143:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272282624 00000100:00100000:1.0:1787574341.916242:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574341.916280:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574341.916283:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272282496 00000100:00100000:0.0:1787574341.916289:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272282496 00000100:00100000:1.0:1787574341.916324:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:0.0:1787574341.916338:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:1.0:1787574341.916346:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2351:x1874407272282624:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574341.916356:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2351:x1874407272282496:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574341.916490:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272282368 00000100:00100000:2.0:1787574341.916500:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272282368 00000100:00100000:2.0:1787574341.916556:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272282752 00000100:00100000:2.0:1787574341.916560:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272282752 00000100:00100000:1.0:1787574341.916597:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2351:x1874407272282624:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 261us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574341.916605:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:3.0:1787574341.916662:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272282240 00000100:00100000:3.0:1787574341.916666:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272282240 00000100:00100000:3.0:1787574341.916692:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 291 00000100:00100000:3.0:1787574341.916699:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+13:2351:x1874407272282240:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574341.917161:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2351:x1874407272282496:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 807us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574341.917203:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:3.0:1787574341.917714:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+13:2351:x1874407272282240:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 999us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574341.917725:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 291 00000100:00080000:3.0:1787574341.917785:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787574341.917791:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574341.920098:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 142 00000100:00100000:2.0:1787574341.920130:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+14:2351:x1874407272282368:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574341.920224:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+14:2351:x1874407272282368:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 113us (4242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574341.920231:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 142 00000100:00100000:2.0:1787574341.920250:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 143 00000100:00100000:2.0:1787574341.920258:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f782322b-3b13-413b-a1b9-4500fa873ef8+6:2351:x1874407272282752:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574341.920282:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f782322b-3b13-413b-a1b9-4500fa873ef8+6:2351:x1874407272282752:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 26us (4003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574341.920289:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 143 00000040:00080000:1.0:1787574342.068046:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787574342.068059:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787574342.068515:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1787574342.068524:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787574342.257797:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290116096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574342.257880:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574342.257955:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290116096 00000100:00100000:0.0:1787574342.257969:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290116096 00000100:00100000:0.0:1787574342.258060:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787574342.258079:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41db9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290116096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574342.258134:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787574342.258245:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574342.258720:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41db9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290116096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 641us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574342.258730:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787574342.265050:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290116096:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787574342.385465:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787574342.834132:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1787574342.834148:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1787574342.834192:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1787574342.834204:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1787574343.409480:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787574343.622664:0:12310:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:25:42 (1787574342) 00010000:00010000:1.0:1787574344.435355:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574345.101997:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574345.102266:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272283008 00000100:00100000:2.0:1787574345.102278:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272283008 00000100:00100000:2.0:1787574345.102365:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 137 00000100:00100000:2.0:1787574345.102377:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41db8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+13:11295:x1874407272283008:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787574345.102411:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574345.102437:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c00cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ed06 expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.102526:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c00d6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.102542:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c00d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.102557:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c00d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.102571:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c00dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.102578:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c00dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.102585:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c00dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787574345.102937:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787574345.103548:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c00e4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.103562:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c00e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.103578:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c00e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574345.103591:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787574345.104622:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c00d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.104637:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c00d6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.104644:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c00d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.104651:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fba00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574345.104656:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c00d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.104665:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c00d6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.104682:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff982a04dc0e00) 00010000:00010000:2.0:1787574345.104685:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574345.104690:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c00d6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.104696:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c00d6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.104711:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c00dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.104718:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c00dd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.104732:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c00dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.104738:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fa600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574345.104741:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c00dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.104746:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c00dd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.104851:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff982a03b34000) 00010000:00010000:2.0:1787574345.104854:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574345.104857:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c00dd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.104863:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c00dd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.105798:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c00cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed06 expref: 16 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.105822:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c00e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed06 expref: 15 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.105830:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982a04da2c00) 00010000:00010000:2.0:1787574345.105833:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574345.105836:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fac00, rc 0) 00000100:00100000:2.0:1787574345.105924:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41db8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+15:11295:x1874407272283008:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 3548us (3939us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1787574345.105944:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 137 00000100:00100000:3.0:1787574345.113306:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574345.114003:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272283136 00000100:00100000:1.0:1787574345.114032:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272283136 00000100:00100000:1.0:1787574345.114125:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 138 00000100:00100000:1.0:1787574345.114137:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+15:11295:x1874407272283136:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787574345.114341:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+15:11295:x1874407272283136:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 205us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574345.114350:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 138 00000100:00100000:1.0:1787574345.123422:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574345.127598:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272283264 00000100:00100000:2.0:1787574345.127621:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272283264 00000100:00100000:2.0:1787574345.127810:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:2.0:1787574345.127823:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+15:2352:x1874407272283264:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574345.127847:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574345.127879:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c00e4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed06 expref: 15 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574345.127906:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982a04da2c00) 00010000:00010000:2.0:1787574345.127912:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574345.127993:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+14:2352:x1874407272283264:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 173us (4586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574345.128003:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000040:00080000:3.0:1787574345.137423:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787574345.137432:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787574345.137481:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1787574345.137486:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787574345.458000:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574345.842162:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290116480:0@lo:400:kworker.0 00000100:00100000:1.0:1787574345.842866:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290116224:0@lo:400:kworker.0 00000100:00100000:3.0:1787574345.842997:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874407290116352:0@lo:400:kworker.0 00000100:00100000:1.0:1787574345.843624:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574345.843719:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874407290116736:0@lo:400:kworker.0 00000100:00100000:1.0:1787574345.843762:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574345.843867:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290116224 00000100:00100000:1.0:1787574345.843886:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290116224 00000100:00100000:1.0:1787574345.843952:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787574345.843962:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:3300:x1874407290116224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574345.844036:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:3300:x1874407290116224:12345-0@lo:400:kworker.0 Request processed in 75us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574345.844043:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787574345.844087:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290116736 00000100:00100000:1.0:1787574345.844091:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290116736 00000100:00100000:1.0:1787574345.844137:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787574345.844143:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874407290116736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574345.844210:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874407290116736:12345-0@lo:400:kworker.0 Request processed in 67us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574345.844217:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:1.0:1787574345.844253:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574345.844288:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290116224:0@lo:400:kworker.0 00000100:00100000:1.0:1787574345.844305:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874407290116736:0@lo:400:kworker.0 00000100:00100000:1.0:1787574345.844351:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290116608:0@lo:400:kworker.0 00000100:00100000:1.0:1787574345.844400:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574345.844437:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290116608 00000100:00100000:1.0:1787574345.844441:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290116608 00000100:00100000:1.0:1787574345.844478:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787574345.844485:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982906428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290116608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574345.844521:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982906428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290116608:12345-0@lo:400:kworker.0 Request processed in 37us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574345.844527:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1787574345.844545:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574345.844560:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290116608:0@lo:400:kworker.0 00000100:00100000:3.0:1787574345.850032:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574345.850104:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290116864:0@lo:400:kworker.0 00000100:00100000:3.0:1787574345.850149:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574345.850342:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290116352 00000100:00100000:2.0:1787574345.850352:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290116352 00000100:00100000:2.0:1787574345.850416:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787574345.850428:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874407290116352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574345.850497:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874407290116352:12345-0@lo:400:kworker.0 Request processed in 71us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574345.850505:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787574345.850932:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874407290116352:0@lo:400:kworker.0 00000100:00100000:0.0:1787574345.853571:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574345.853796:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290116864 00000100:00100000:0.0:1787574345.853807:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290116864 00000100:00100000:0.0:1787574345.853889:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787574345.853902:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290116864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574345.853974:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290116864:12345-0@lo:400:kworker.0 Request processed in 76us (3824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574345.853981:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787574345.854052:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290116864:0@lo:400:kworker.0 00000100:00080000:3.0:1787574345.854203:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574345.857145:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290116480 00000100:00100000:2.0:1787574345.857180:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290116480 00000100:00100000:2.0:1787574345.857279:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787574345.857292:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290116480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574345.857415:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290116480:12345-0@lo:400:kworker.0 Request processed in 126us (3854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574345.857435:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787574345.857506:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290116480:0@lo:400:kworker.0 00000100:00080000:3.0:1787574345.857912:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574346.358762:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98290642aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290116992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574346.358857:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574346.358951:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290116992 00000100:00100000:1.0:1787574346.358961:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290116992 00000100:00100000:1.0:1787574346.359159:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787574346.359192:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982906428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290116992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574346.359237:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787574346.359296:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982906428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290116992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574346.359304:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787574346.359363:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98290642aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290116992:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787574346.481380:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574347.037978:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574347.038041:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574347.038072:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574347.038091:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574347.038116:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574347.038147:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272283392 00000100:00100000:0.0:1787574347.038158:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272283392 00000100:00100000:0.0:1787574347.038244:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 293 00000100:00100000:0.0:1787574347.038256:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:2352:x1874407272283392:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574347.038355:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:2352:x1874407272283392:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 100us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574347.038363:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 293 00000100:00100000:0.0:1787574347.038403:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272283520 00000100:00100000:0.0:1787574347.038407:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272283520 00000100:00100000:0.0:1787574347.038450:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272283904 00000100:00100000:0.0:1787574347.038453:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272283904 00000100:00100000:0.0:1787574347.038495:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 147 00000100:00100000:0.0:1787574347.038502:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+14:2353:x1874407272283520:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574347.038542:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+14:2353:x1874407272283520:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 42us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574347.038549:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 147 00000100:00100000:0.0:1787574347.038561:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 148 00000100:00100000:0.0:1787574347.038568:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f782322b-3b13-413b-a1b9-4500fa873ef8+6:2352:x1874407272283904:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574347.038591:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f782322b-3b13-413b-a1b9-4500fa873ef8+6:2352:x1874407272283904:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574347.038596:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 148 00000100:00080000:0.0:1787574347.038612:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574347.038798:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272283648 00000100:00100000:1.0:1787574347.038805:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272283648 00000100:00100000:1.0:1787574347.038860:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272283776 00000100:00100000:1.0:1787574347.038864:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272283776 00000100:00100000:2.0:1787574347.038907:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:2.0:1787574347.038934:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2352:x1874407272283648:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:0.0:1787574347.038938:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574347.038945:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574347.039022:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2352:x1874407272283648:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 90us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574347.040771:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:1.0:1787574347.040799:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2353:x1874407272283776:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574347.040885:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2353:x1874407272283776:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 102us (2767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574347.040893:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:2.0:1787574347.045828:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:1.0:1787574347.205112:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574347.205236:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272284032 00000100:00100000:2.0:1787574347.205248:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272284032 00000100:00100000:2.0:1787574347.205325:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 139 00000100:00100000:2.0:1787574347.205337:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98290642aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+14:11337:x1874407272284032:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1787574347.205365:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574347.205392:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c00f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ed0d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.205477:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646c00f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.205494:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646c00f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.205509:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646c00f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.205525:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c0100 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.205548:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c0100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.205555:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c0100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.205832:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646c00f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.205841:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646c00f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.205848:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646c00f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.205856:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fbc00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574347.205861:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646c00f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.205870:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646c00f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.205885:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34300) 00010000:00010000:2.0:1787574347.205889:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574347.205895:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646c00f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.205902:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646c00f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.205915:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c0100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.205928:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c0100 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.205934:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c0100 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.205938:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fae00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574347.205941:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c0100 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.205947:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c0100 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.205955:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff982a03b34000) 00010000:00010000:2.0:1787574347.205958:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574347.205960:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c0100 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.205966:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c0100 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.206002:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c00f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed0d expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.206025:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34300) 00010000:00010000:2.0:1787574347.206029:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574347.206033:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c00f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed0d expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.206042:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fba00, rc 0) 00000100:00100000:2.0:1787574347.206124:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98290642aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+14:11337:x1874407272284032:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 788us (1024us total) trans 0 rc 301/301 00000100:00100000:2.0:1787574347.206132:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 139 00000100:00100000:0.0:1787574347.226410:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574347.234573:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272284288 00000100:00100000:1.0:1787574347.234597:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272284288 00000100:00100000:1.0:1787574347.234690:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 140 00000100:00100000:1.0:1787574347.234704:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+14:11337:x1874407272284288:12345-192.168.206.51@tcp:36:lfs.0 00010000:00010000:1.0:1787574347.234777:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574347.234812:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a1d2ab400/0xfe91058e646bfa70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb46 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.234838:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34300) 00010000:00010000:1.0:1787574347.234843:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787574347.235197:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0107 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.235215:0:7646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c00c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecff expref: 5 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.235226:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0107 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.235582:0:7646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c00c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecff expref: 5 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.235599:0:7646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c00c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecff expref: 5 pid: 5831 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574347.235617:0:7646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98290642b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7646:1874407290117120:192.168.206.51@tcp:104: 00000100:00100000:1.0:1787574347.235762:0:7646:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3d01dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574347.248675:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574347.248743:0:7646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98290642b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7646:1874407290117120:192.168.206.51@tcp:104: 00010000:00010000:1.0:1787574347.248779:0:7646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0107 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574347.248865:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272284416 00000100:00100000:0.0:1787574347.248876:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272284416 00010000:00010000:0.0:1787574347.248929:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c00c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecff expref: 6 pid: 5831 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574347.248982:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:0.0:1787574347.248993:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f782322b-3b13-413b-a1b9-4500fa873ef8+6:2350:x1874407272284416:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574347.249020:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574347.249029:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c00c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecff expref: 6 pid: 5831 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574347.249044:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c00c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecff expref: 6 pid: 5831 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574347.249083:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c00c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecff expref: 6 pid: 5831 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574347.249099:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34300) 00010000:00010000:0.0:1787574347.249105:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0107 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574347.249116:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0107 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574347.249124:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0107 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574347.249156:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574347.249248:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2350:x1874407272284416:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 255us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574347.249256:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00010000:00010000:1.0:1787574347.249525:0:7646:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0107 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.249533:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0107 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.249564:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c010e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.249575:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c010e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.249584:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c010e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574347.253053:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787574347.253080:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0107 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.253105:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0107 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.253114:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0107 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.253122:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574347.253128:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0107 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.253138:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0107 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.253160:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34300) 00010000:00010000:1.0:1787574347.253190:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574347.253196:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0107 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.253202:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0107 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787574347.253226:0:7646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e0c3fce reply state 00000000cf8b64ed transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c010e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574347.253237:0:7646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787574347.253379:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+15:11337:x1874407272284288:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 18673us (27219us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1787574347.253391:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 140 00010000:00010000:1.0:1787574347.264750:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c010e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.264787:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c010e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.264795:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c010e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.264802:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574347.264808:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c010e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.264817:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c010e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.264839:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff982a04da2f00) 00010000:00010000:1.0:1787574347.264843:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574347.264849:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c010e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.264856:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c010e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574347.377517:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290117248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574347.377615:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574347.377784:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290117248 00000100:00100000:3.0:1787574347.377794:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290117248 00000100:00100000:3.0:1787574347.377881:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787574347.377893:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98290642b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290117248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787574347.377940:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787574347.377997:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98290642b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290117248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574347.378005:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787574347.378201:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290117248:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787574347.378358:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574347.414724:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574347.414853:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272284544 00000100:00100000:2.0:1787574347.414873:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272284544 00000100:00100000:2.0:1787574347.414964:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 141 00000100:00100000:2.0:1787574347.414979:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+14:11345:x1874407272284544:12345-192.168.206.51@tcp:101:lctl.0 00010000:00010000:2.0:1787574347.415021:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574347.415051:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c0115 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ed14 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.415393:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646c011c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.415410:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646c011c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.415424:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646c011c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574347.415499:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787574347.415503:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787574347.415534:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646c011c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.415567:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c0115 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed14 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.415590:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646c011c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed14 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.415623:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34000) 00010000:00010000:2.0:1787574347.415626:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787574347.415630:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fbc00, rc 0) 00000100:00100000:2.0:1787574347.415708:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+15:11345:x1874407272284544:12345-192.168.206.51@tcp:101:lctl.0 Request processed in 732us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574347.415716:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 141 00010000:00010000:0.0:1787574347.505509:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574347.526069:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574347.526804:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272284672 00000100:00100000:2.0:1787574347.526814:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272284672 00000100:00100000:2.0:1787574347.527352:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 142 00000100:00100000:2.0:1787574347.527365:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+15:11351:x1874407272284672:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1787574347.527386:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574347.527418:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c0123 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ed1b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.527482:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c012a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.527495:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c012a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.527505:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c012a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.527519:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0131 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.527535:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0131 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.527562:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0131 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.527672:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa800/0xfe91058e646c0138 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.527856:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa800/0xfe91058e646c0138 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.527864:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa800/0xfe91058e646c0138 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574347.527901:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787574347.527905:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787574347.527927:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa800/0xfe91058e646c0138 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.527941:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c012a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.527947:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c012a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.527952:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c012a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.527957:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fb000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574347.527961:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c012a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.527968:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c012a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.527989:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34000) 00010000:00010000:2.0:1787574347.527992:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574347.527998:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c012a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.528003:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c012a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.528027:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0131 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.528034:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0131 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.528040:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0131 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.528044:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fa400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574347.528047:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0131 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.528052:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0131 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.528059:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff982a03b34900) 00010000:00010000:2.0:1787574347.528062:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574347.528065:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0131 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.528071:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0131 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.528117:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c0123 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed1b expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.528130:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa800/0xfe91058e646c0138 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed1b expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.528137:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:2.0:1787574347.528139:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787574347.528142:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fa800, rc 0) 00000100:00100000:2.0:1787574347.528909:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+16:11351:x1874407272284672:12345-192.168.206.51@tcp:101:bash.0 Request processed in 1544us (2847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574347.528918:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 142 00000100:00100000:0.0:1787574347.536616:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574347.537114:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272284928 00000100:00100000:1.0:1787574347.537126:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272284928 00000100:00100000:1.0:1787574347.537238:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 143 00000100:00100000:1.0:1787574347.537249:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+16:11351:x1874407272284928:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1787574347.537286:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574347.537307:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c013f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ed22 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.537839:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0146 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.537855:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0146 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.537866:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0146 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.543801:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c014d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.543824:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c014d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.543837:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c014d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787574347.546461:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1787574347.547928:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c0154 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.547946:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c0154 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.547957:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c0154 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.548003:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0146 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.548021:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0146 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.548028:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0146 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.548034:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574347.548038:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0146 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.548044:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0146 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.548056:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:1.0:1787574347.548058:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574347.548061:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0146 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.548067:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0146 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787574347.548079:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000075b4ad3 reply state 000000004ef6afc1 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c014d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574347.548087:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787574347.548121:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c013f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed22 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.548144:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c0154 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed22 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.549471:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2a00) 00010000:00010000:1.0:1787574347.549479:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787574347.549483:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0400, rc 0) 00000100:00100000:1.0:1787574347.549569:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:11351:x1874407272284928:12345-192.168.206.51@tcp:101:bash.0 Request processed in 12320us (12963us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1787574347.549579:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 143 00010000:00010000:1.0:1787574347.552205:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c014d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.552221:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c014d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.552229:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c014d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.552236:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1e00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574347.552241:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c014d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.552249:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c014d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.552267:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982a04da2f00) 00010000:00010000:1.0:1787574347.552270:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574347.552276:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c014d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.552297:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c014d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574347.554035:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574347.554105:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272285056 00000100:00100000:1.0:1787574347.554114:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272285056 00000100:00100000:1.0:1787574347.554212:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:1.0:1787574347.554222:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2350:x1874407272285056:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1787574347.554240:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574347.554261:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004af6f85e/0xfe91058e646c0162 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ed29 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787574347.554288:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787574347.554308:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=323s v=(0 0) 00010000:00010000:1.0:1787574347.554313:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574347.554323:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004af6f85e/0xfe91058e646c0162 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed29 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.554348:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004af6f85e/0xfe91058e646c0162 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed29 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.554362:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0e00, rc 0) 00000100:00100000:1.0:1787574347.554413:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2350:x1874407272285056:12345-192.168.206.51@tcp:101:bash.0 Request processed in 189us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574347.554420:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:0.0:1787574347.560047:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574347.560872:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272285184 00000100:00100000:1.0:1787574347.562313:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272285184 00000100:00100000:1.0:1787574347.562401:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:1.0:1787574347.562410:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:11351:x1874407272285184:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1787574347.562427:0:8472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574347.562444:0:8472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006430e4b4/0xfe91058e646c0169 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ed30 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.562475:0:8472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004af6f85e/0xfe91058e646c0162 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed29 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.562483:0:8472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574347.562487:0:8472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574347.562492:0:8472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006430e4b4/0xfe91058e646c0169 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed30 expref: 7 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.562525:0:8472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004af6f85e/0xfe91058e646c0162 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed29 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.562540:0:8472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004af6f85e/0xfe91058e646c0162 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed29 expref: 7 pid: 6682 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574347.562554:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98290642bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8472:1874407290117376:192.168.206.51@tcp:104: 00000100:00100000:1.0:1787574347.562652:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3d01dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574347.572554:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574347.573094:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272285312 00000100:00100000:0.0:1787574347.573106:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272285312 00010000:00010000:0.0:1787574347.573162:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004af6f85e/0xfe91058e646c0162 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed29 expref: 8 pid: 6682 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574347.573262:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:0.0:1787574347.573273:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2350:x1874407272285312:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574347.573287:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574347.573310:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004af6f85e/0xfe91058e646c0162 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed29 expref: 8 pid: 6682 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574347.573325:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004af6f85e/0xfe91058e646c0162 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed29 expref: 8 pid: 6682 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574347.573350:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574347.573355:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574347.573363:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006430e4b4/0xfe91058e646c0169 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed30 expref: 8 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574347.573374:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006430e4b4/0xfe91058e646c0169 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed30 expref: 8 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574347.573428:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006430e4b4/0xfe91058e646c0169 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed30 expref: 8 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574347.573444:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5816:1874407290117504:192.168.206.51@tcp:105: 00000100:00100000:0.0:1787574347.573525:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a26fc6cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1787574347.576226:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004af6f85e/0xfe91058e646c0162 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed29 expref: 8 pid: 6682 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574347.576250:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98290642bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8472:1874407290117376:192.168.206.51@tcp:104: 00010000:00010000:1.0:1787574347.576296:0:8472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006430e4b4/0xfe91058e646c0169 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed30 expref: 7 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.576311:0:8472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0600, rc 0) 00000100:00100000:1.0:1787574347.576376:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:11351:x1874407272285184:12345-192.168.206.51@tcp:101:bash.0 Request processed in 13966us (16337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574347.576385:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:1.0:1787574347.577851:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5816:1874407290117504:192.168.206.51@tcp:105: 00010000:00010000:1.0:1787574347.577876:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574347.577917:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2350:x1874407272285312:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 4646us (5373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574347.577926:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:3.0:1787574347.581253:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574347.581381:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272285568 00000100:00100000:2.0:1787574347.581390:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272285568 00000100:00100000:2.0:1787574347.581458:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:2.0:1787574347.581469:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+18:11351:x1874407272285568:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:2.0:1787574347.581835:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:11351:x1874407272285568:12345-192.168.206.51@tcp:35:bash.0 Request processed in 367us (591us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1787574347.581842:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:0.0:1787574347.739312:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574347.739419:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272285824 00000100:00100000:1.0:1787574347.739428:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272285824 00000100:00100000:1.0:1787574347.739508:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 144 00000100:00100000:1.0:1787574347.739519:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:11361:x1874407272285824:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1787574347.739543:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574347.739564:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646c0170 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ed37 expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574347.739696:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787574347.739815:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646c0170 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed37 expref: 21 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.739829:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34000) 00010000:00010000:1.0:1787574347.739832:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787574347.739854:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646c0170 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed37 expref: 21 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.739869:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0e00, rc 0) 00000100:00100000:1.0:1787574347.740071:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+20:11361:x1874407272285824:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 553us (769us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1787574347.740079:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 144 00000100:00100000:0.0:1787574347.757465:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574347.757692:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272286080 00000100:00100000:2.0:1787574347.757703:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272286080 00000100:00100000:2.0:1787574347.757765:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:2.0:1787574347.757776:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+20:11361:x1874407272286080:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1787574347.758056:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+21:11361:x1874407272286080:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 281us (600us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1787574347.758071:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:3.0:1787574347.876512:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574347.876809:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272286208 00000100:00100000:2.0:1787574347.876819:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272286208 00000100:00100000:2.0:1787574347.876881:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 145 00000100:00100000:2.0:1787574347.876891:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+21:11367:x1874407272286208:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1787574347.876914:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574347.876935:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c017e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ed3e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.876995:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c0185 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.877022:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c0185 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.877036:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c0185 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574347.877096:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787574347.877101:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787574347.877122:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c0185 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.877147:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c017e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed3e expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.877239:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c0185 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed3e expref: 22 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.877270:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:2.0:1787574347.877272:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787574347.877276:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fb000, rc 0) 00000100:00100000:2.0:1787574347.877329:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+22:11367:x1874407272286208:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 439us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574347.877336:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 145 00000100:00100000:0.0:1787574347.882275:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574347.882418:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272286464 00000100:00100000:1.0:1787574347.882427:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272286464 00000100:00100000:1.0:1787574347.882484:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 146 00000100:00100000:1.0:1787574347.882495:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+22:11367:x1874407272286464:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1787574347.882514:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574347.882532:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646c018c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ed45 expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.882623:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0193 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.882636:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0193 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.882645:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0193 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574347.882656:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787574347.882798:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646c018c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed45 expref: 25 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.882816:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0193 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed45 expref: 24 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.882840:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2a00) 00010000:00010000:1.0:1787574347.882843:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787574347.882847:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1e00, rc 0) 00000100:00100000:1.0:1787574347.882912:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+24:11367:x1874407272286464:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 419us (646us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1787574347.882920:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 146 00000100:00100000:0.0:1787574347.888025:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574347.888076:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574347.888155:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272286592 00000100:00100000:1.0:1787574347.888196:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272286592 00000100:00100000:1.0:1787574347.888260:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:1.0:1787574347.888271:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+24:2350:x1874407272286592:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574347.888288:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574347.888314:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0193 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed45 expref: 24 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.888333:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2a00) 00010000:00010000:1.0:1787574347.888338:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574347.888392:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+23:2350:x1874407272286592:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 123us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574347.888400:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:2.0:1787574347.888825:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272286848 00000100:00100000:2.0:1787574347.888831:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272286848 00000100:00100000:2.0:1787574347.888866:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 147 00000100:00100000:2.0:1787574347.888874:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+23:11367:x1874407272286848:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1787574347.888895:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574347.888911:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c01a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ed4c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.889016:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c01a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.889029:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c01a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.889039:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c01a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574347.889051:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787574347.889213:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c01a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed4c expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.889249:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c01a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed4c expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.889257:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2a00) 00010000:00010000:2.0:1787574347.889260:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787574347.889262:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fa000, rc 0) 00000100:00100000:2.0:1787574347.889297:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+25:11367:x1874407272286848:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 424us (1295us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787574347.889304:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 147 00000100:00100000:0.0:1787574347.909222:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574347.909316:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272286976 00000100:00100000:1.0:1787574347.909325:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272286976 00000100:00100000:1.0:1787574347.909380:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:1.0:1787574347.909390:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2353:x1874407272286976:12345-192.168.206.51@tcp:1:lfs.0 00010000:00010000:1.0:1787574347.909435:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022424585/0xfe91058e646c01b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.909469:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006430e4b4/0xfe91058e646c0169 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed30 expref: 6 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.909478:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787574347.909493:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787574347.909498:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022424585/0xfe91058e646c01b6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.909534:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006430e4b4/0xfe91058e646c0169 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed30 expref: 6 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.909546:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006430e4b4/0xfe91058e646c0169 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed30 expref: 6 pid: 8472 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574347.909562:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98290642bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6682:1874407290117632:192.168.206.51@tcp:104: 00000100:00100000:1.0:1787574347.909658:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3d01d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787574347.922305:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574347.922755:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98290642bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6682:1874407290117632:192.168.206.51@tcp:104: 00010000:00010000:2.0:1787574347.922783:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000022424585/0xfe91058e646c01b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574347.923090:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272287104 00000100:00100000:3.0:1787574347.923098:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272287104 00002000:00100000:3.0:1787574347.923158:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff982a419a2300 x1874407272287104/t0(0) o4->a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp:118/0 lens 504/0 e 0 to 0 dl 1787574358 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787574347.923203:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a419a2300 with x1874407272287104 ext(0->12) 00010000:00010000:3.0:1787574347.923211:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006430e4b4/0xfe91058e646c0169 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed30 expref: 7 pid: 8472 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574347.923226:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006430e4b4/0xfe91058e646c0169 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed30 expref: 7 pid: 8472 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787574347.923232:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff982a419a2300 00000100:00100000:3.0:1787574347.923257:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:3.0:1787574347.923267:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2350:x1874407272287104:12345-192.168.206.51@tcp:4:lfs.0 00000100:00100000:3.0:1787574347.925761:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:2350:x1874407272287104:12345-192.168.206.51@tcp:4:lfs.0 Request processed in 2484us (3455us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787574347.925775:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00002000:00100000:3.0:1787574347.925786:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff982a419a2300 x1874407272287104/t4294967305(0) o4->a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp:118/0 lens 504/448 e 0 to 0 dl 1787574358 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787574347.925796:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a419a2300 with x1874407272287104 ext(0->12) 00010000:00010000:3.0:1787574347.925808:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006430e4b4/0xfe91058e646c0169 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed30 expref: 9 pid: 8472 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574347.925828:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006430e4b4/0xfe91058e646c0169 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed30 expref: 9 pid: 8472 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787574347.925837:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff982a419a2300 00000100:00100000:3.0:1787574347.934333:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574347.940655:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272287232 00000100:00100000:2.0:1787574347.940682:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272287232 00010000:00010000:2.0:1787574347.940732:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006430e4b4/0xfe91058e646c0169 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed30 expref: 9 pid: 8472 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574347.940843:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:2.0:1787574347.940854:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:2352:x1874407272287232:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574347.940868:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787574347.940889:0:5817:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787574347.940893:0:5817:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787574347 00002000:00010000:2.0:1787574347.940895:0:5817:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787574347 00002000:00010000:2.0:1787574347.940909:0:5817:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787574347 00010000:00010000:2.0:1787574347.940916:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006430e4b4/0xfe91058e646c0169 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed30 expref: 9 pid: 8472 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.940931:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006430e4b4/0xfe91058e646c0169 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed30 expref: 9 pid: 8472 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.940957:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006430e4b4/0xfe91058e646c0169 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed30 expref: 9 pid: 8472 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.940975:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574347.940980:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574347.940986:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000022424585/0xfe91058e646c01b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.940995:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022424585/0xfe91058e646c01b6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574347.941036:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574347.941098:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2352:x1874407272287232:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 246us (6775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574347.941107:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 64 00000001:00080000:3.0:1787574347.943234:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967421 is committed 00000001:00080000:3.0:1787574347.943257:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967422 is committed 00010000:00010000:3.0:1787574347.946467:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000022424585/0xfe91058e646c01b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574347.946497:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022424585/0xfe91058e646c01b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574347.946540:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022424585/0xfe91058e646c01b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574347.946548:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022424585/0xfe91058e646c01b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574347.946555:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022424585/0xfe91058e646c01b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574347.946562:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1e00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:3.0:1787574347.946566:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022424585/0xfe91058e646c01b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574347.946574:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022424585/0xfe91058e646c01b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574347.946597:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022424585/0xfe91058e646c01b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574347.946631:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022424585/0xfe91058e646c01b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574347.946747:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2353:x1874407272286976:12345-192.168.206.51@tcp:1:lfs.0 Request processed in 37352us (37528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574347.946757:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:0.0:1787574347.955776:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574347.958295:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272287488 00000100:00100000:2.0:1787574347.958312:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272287488 00000100:00100000:3.0:1787574347.962822:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:3.0:1787574347.962842:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0327d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+17:11367:x1874407272287488:12345-192.168.206.51@tcp:35:lfs.0 00000004:00010000:3.0:1787574347.962907:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c01a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed4c expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787574347.963379:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1787574347.963434:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1787574347.965439:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1787574347.965520:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c01bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574347.965540:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c0154 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed22 expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574347.965549:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c01bd lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574347.965588:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c0154 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed22 expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574347.965605:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c0154 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed22 expref: 21 pid: 5831 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574347.965628:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a418a5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1874407290117760:192.168.206.51@tcp:104: 00000100:00100000:3.0:1787574347.966060:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a05c08a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574347.969713:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574347.970280:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a418a5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1874407290117760:192.168.206.51@tcp:104: 00010000:00010000:3.0:1787574347.970304:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c01bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574347.970415:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272287616 00000100:00100000:1.0:1787574347.970424:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272287616 00010000:00010000:1.0:1787574347.970473:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c0154 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed22 expref: 22 pid: 5831 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574347.970668:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:1.0:1787574347.970689:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a063a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+22:2352:x1874407272287616:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574347.970704:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574347.970712:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c0154 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed22 expref: 22 pid: 5831 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.970738:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c0154 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed22 expref: 22 pid: 5831 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.970760:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c0154 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed22 expref: 22 pid: 5831 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.970774:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2a00) 00010000:00010000:1.0:1787574347.970779:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c01bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.970788:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c01bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.970794:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c01bd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.970828:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574347.970886:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a063a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+21:2352:x1874407272287616:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 199us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574347.970894:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 65 00010000:00010000:0.0:1787574347.971259:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c01bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574347.971268:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c01bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787574347.971393:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1787574347.971617:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1787574347.971734:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1874407290117888:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787574347.971785:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574347.971824:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a26fc6180 going to sleep for 11 seconds 00000100:00100000:2.0:1787574347.972207:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290117888 00000100:00100000:2.0:1787574347.972215:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290117888 00000100:00100000:2.0:1787574347.972262:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787574347.972271:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1874407290117888:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787574347.972356:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1874407290117888:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 86us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574347.972363:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787574347.972738:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787574347.972776:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1874407290117888:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787574347.973303:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1787574347.973371:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41891180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1874407290118016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787574347.973413:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574347.973436:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a26fc6900 going to sleep for 11 seconds 00000100:00100000:0.0:1787574347.973771:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290118016 00000100:00100000:0.0:1787574347.973778:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290118016 00000100:00100000:0.0:1787574347.973828:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787574347.973837:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1874407290118016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787574347.974021:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1874407290118016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 184us (606us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787574347.974028:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787574347.974068:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41891180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1874407290118016:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787574347.974115:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1787574347.974150:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c01bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574347.974161:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c01bd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574347.974202:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c01bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574347.974209:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16143000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574347.974214:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c01bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574347.974222:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c01bd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574347.974239:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2a00) 00010000:00010000:0.0:1787574347.974243:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787574347.974248:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c01bd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574347.974255:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c01bd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787574347.974435:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787574347.975366:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1787574347.975380:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 324150213334ns, next at 325150210741ns, rc = 0 00000001:00080000:0.0:1787574347.975388:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1787574347.975430:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2a00) 00010000:00010000:0.0:1787574347.975433:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787574347.975443:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c01a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed4c expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574347.975830:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0327d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+24:11367:x1874407272287488:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 12994us (20061us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1787574347.975839:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00000020:00080000:0.0:1787574347.975844:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787574347.978412:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574347.978490:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272287744 00000100:00100000:1.0:1787574347.978500:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272287744 00000100:00100000:1.0:1787574347.978798:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 148 00000100:00100000:1.0:1787574347.978811:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+24:11367:x1874407272287744:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1787574347.978834:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574347.978859:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646c01c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ed53 expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.978938:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646c01c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed53 expref: 25 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.978953:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646c01c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed53 expref: 25 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574347.978973:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:1.0:1787574347.978976:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787574347.978980:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0e00, rc 0) 00000100:00100000:1.0:1787574347.979051:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+25:11367:x1874407272287744:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 242us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574347.979058:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 148 00000100:00100000:3.0:1787574347.982043:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574347.982132:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272288000 00000100:00100000:0.0:1787574347.982142:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272288000 00000100:00100000:0.0:1787574347.982229:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:0.0:1787574347.982239:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+25:11367:x1874407272288000:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1787574347.982477:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+26:11367:x1874407272288000:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 239us (443us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1787574347.982493:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:0.0:1787574348.076308:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574348.076406:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272288256 00000100:00100000:2.0:1787574348.076418:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272288256 00000100:00100000:2.0:1787574348.076500:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 149 00000100:00100000:2.0:1787574348.076512:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a069fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+26:11377:x1874407272288256:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1787574348.076537:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574348.076557:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ed5a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574348.076838:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787574348.077002:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01cb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed5a expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.077032:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34000) 00010000:00010000:2.0:1787574348.077035:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787574348.077040:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed5a expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.077054:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fbe00, rc 0) 00000100:00100000:2.0:1787574348.077113:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a069fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+27:11377:x1874407272288256:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 603us (814us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1787574348.077121:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 149 00000100:00100000:3.0:1787574348.085347:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574348.085456:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272288384 00000100:00100000:2.0:1787574348.085467:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272288384 00000100:00100000:2.0:1787574348.085537:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 150 00000100:00100000:2.0:1787574348.085562:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+27:11377:x1874407272288384:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:2.0:1787574348.085641:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.085657:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.085668:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.085694:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c01e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.085702:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c01e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.085710:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c01e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086030:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646c01e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086039:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646c01e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086046:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646c01e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787574348.086087:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646c01e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086101:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086114:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086121:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086127:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fbe00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574348.086131:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086138:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086153:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:2.0:1787574348.086156:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574348.086161:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086212:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086225:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c01e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086231:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c01e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086237:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c01e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086242:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fb200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574348.086252:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c01e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086259:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c01e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086268:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982a03b34300) 00010000:00010000:2.0:1787574348.086271:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574348.086274:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c01e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086280:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c01e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086293:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646c01e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086300:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646c01e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086306:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646c01e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086311:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fa200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574348.086314:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646c01e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086321:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646c01e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086329:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:2.0:1787574348.086331:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574348.086340:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646c01e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.086347:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646c01e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574348.086419:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+27:11377:x1874407272288384:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 857us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574348.086427:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 150 00000100:00100000:3.0:1787574348.089509:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574348.089609:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272288640 00000100:00100000:0.0:1787574348.089619:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272288640 00000100:00100000:0.0:1787574348.089671:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:0.0:1787574348.089692:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+27:11377:x1874407272288640:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1787574348.090158:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+28:11377:x1874407272288640:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 468us (658us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787574348.090217:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:0.0:1787574348.133200:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574348.133302:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272288896 00000100:00100000:2.0:1787574348.133313:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272288896 00000100:00100000:2.0:1787574348.133373:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 151 00000100:00100000:2.0:1787574348.133383:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+28:11380:x1874407272288896:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1787574348.133406:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574348.133427:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646c01ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ed61 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.133547:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c01f5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.133561:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c01f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.133571:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c01f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.133587:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.133594:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.133613:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.133970:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646c0203 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.133980:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646c0203 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.133989:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646c0203 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574348.133998:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787574348.134097:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c01f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.134105:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c01f5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.134113:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c01f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.134119:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fb200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574348.134124:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c01f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.134132:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c01f5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.134144:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:2.0:1787574348.134147:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574348.134158:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c01f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.134201:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c01f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.134215:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.134221:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.134227:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.134232:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fbe00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574348.134235:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.134240:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.134248:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982a03b34300) 00010000:00010000:2.0:1787574348.134250:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574348.134253:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.134259:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c01fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.134299:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646c01ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed61 expref: 31 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.134324:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646c0203 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed61 expref: 30 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.134331:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:2.0:1787574348.134333:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574348.134336:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069faa00, rc 0) 00000100:00100000:2.0:1787574348.134403:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+30:11380:x1874407272288896:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1020us (1236us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787574348.134411:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 151 00000100:00100000:3.0:1787574348.139367:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574348.139488:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272289024 00000100:00100000:2.0:1787574348.139498:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272289024 00000100:00100000:2.0:1787574348.139558:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 152 00000100:00100000:2.0:1787574348.139569:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+30:11380:x1874407272289024:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:2.0:1787574348.139649:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0211 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.139667:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0211 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.139690:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0211 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.139717:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0211 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.139725:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0211 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.139751:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0211 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.139757:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fa000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574348.139762:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0211 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.139770:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0211 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.139782:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:2.0:1787574348.139785:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787574348.139790:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0211 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.139796:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0211 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574348.139870:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+30:11380:x1874407272289024:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 302us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574348.139879:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 152 00000100:00100000:3.0:1787574348.143274:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574348.143813:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272289280 00000100:00100000:0.0:1787574348.143827:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272289280 00000100:00100000:0.0:1787574348.143890:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:0.0:1787574348.143900:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+30:11380:x1874407272289280:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1787574348.144151:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+31:11380:x1874407272289280:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 251us (888us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1787574348.144159:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00010000:00010000:1.0:1787574348.531604:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574348.543764:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574348.543912:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272289536 00000100:00100000:2.0:1787574348.543921:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272289536 00000100:00100000:2.0:1787574348.543982:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 153 00000100:00100000:2.0:1787574348.543993:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+31:11411:x1874407272289536:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:2.0:1787574348.544024:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574348.544044:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0218 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ed68 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.544158:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646c021f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.544213:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646c021f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.544224:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646c021f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574348.544236:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787574348.544376:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0218 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed68 expref: 34 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.544395:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646c021f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed68 expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.544403:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:2.0:1787574348.544406:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574348.544409:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fa200, rc 0) 00000100:00100000:2.0:1787574348.544462:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+33:11411:x1874407272289536:12345-192.168.206.51@tcp:101:cat.0 Request processed in 471us (707us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787574348.544470:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 153 00000100:00100000:3.0:1787574348.552595:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574348.552635:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574348.552712:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272289920 00000100:00100000:3.0:1787574348.552721:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272289920 00000100:00100000:3.0:1787574348.552789:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:3.0:1787574348.552798:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+33:2352:x1874407272289920:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574348.552813:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574348.552841:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa200/0xfe91058e646c021f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed68 expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574348.552861:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:3.0:1787574348.552866:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574348.552918:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+32:2352:x1874407272289920:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 121us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574348.552942:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:3.0:1787574348.552966:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272289792 00000100:00100000:3.0:1787574348.552969:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272289792 00000100:00100000:3.0:1787574348.552991:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:3.0:1787574348.552998:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+32:11411:x1874407272289792:12345-192.168.206.51@tcp:35:cat.0 00000100:00100000:3.0:1787574348.553269:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+33:11411:x1874407272289792:12345-192.168.206.51@tcp:35:cat.0 Request processed in 269us (683us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787574348.553633:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00000001:00080000:2.0:1787574348.611591:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1787574348.611617:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1787574348.646956:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574348.647075:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272290176 00000100:00100000:2.0:1787574348.647085:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272290176 00000100:00100000:2.0:1787574348.647145:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 154 00000100:00100000:2.0:1787574348.647156:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+33:11417:x1874407272290176:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1787574348.647231:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574348.647234:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787574348.647260:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c0185 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed3e expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.647278:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:2.0:1787574348.647282:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787574348.647293:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c022d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ed6f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.647378:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c0234 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.647391:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646c0203 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed61 expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.647400:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c0234 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.647429:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646c0203 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed61 expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.647443:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646c0203 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed61 expref: 33 pid: 5832 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574348.647457:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a4122f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874407290118144:192.168.206.51@tcp:104: 00000100:00100000:2.0:1787574348.647565:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a06668840 going to sleep for 11 seconds 00000100:00100000:2.0:1787574348.649626:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a4122f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874407290118144:192.168.206.51@tcp:104: 00010000:00010000:2.0:1787574348.649667:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c0234 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574348.650291:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574348.650787:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272290304 00000100:00100000:2.0:1787574348.650796:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272290304 00010000:00010000:2.0:1787574348.650832:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646c0203 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed61 expref: 34 pid: 5832 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574348.652901:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:2.0:1787574348.652927:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+34:2351:x1874407272290304:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574348.652948:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574348.652959:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646c0203 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed61 expref: 34 pid: 5832 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.652976:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646c0203 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed61 expref: 34 pid: 5832 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.653011:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646c0203 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed61 expref: 34 pid: 5832 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.653029:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:2.0:1787574348.653035:0:8453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c0234 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.653044:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c0234 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.653053:0:8453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c0234 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574348.653102:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574348.653162:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+33:2351:x1874407272290304:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 246us (2874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574348.653186:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 66 00010000:00010000:3.0:1787574348.653301:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c0234 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574348.653309:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c0234 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574348.653327:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787574348.653478:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c022d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed6f expref: 34 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574348.653494:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c0234 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed6f expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574348.653501:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:3.0:1787574348.653503:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787574348.653506:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fbe00, rc 0) 00000100:00100000:3.0:1787574348.653533:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+33:11417:x1874407272290176:12345-192.168.206.51@tcp:101:dd.0 Request processed in 6380us (6588us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1787574348.653546:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 154 00000100:00100000:3.0:1787574348.656774:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574348.656893:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272290560 00000100:00100000:0.0:1787574348.656905:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272290560 00000100:00100000:0.0:1787574348.656968:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 155 00000100:00100000:0.0:1787574348.656979:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+33:11417:x1874407272290560:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:0.0:1787574348.657285:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c0242 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574348.657303:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c0242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574348.657316:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c0242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787574348.657371:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1787574348.657396:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005305e2ef reply state 0000000051091052 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c0242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574348.657405:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574348.657530:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+36:11417:x1874407272290560:12345-192.168.206.51@tcp:36:dd.0 Request processed in 553us (765us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1787574348.657538:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 155 00000020:00080000:0.0:1787574348.657542:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787574348.659758:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c0242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574348.659774:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c0242 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574348.659782:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c0242 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574348.659789:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574348.659794:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c0242 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574348.659802:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c0242 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574348.659836:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:1.0:1787574348.659839:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574348.659844:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c0242 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574348.659850:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c0242 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574349.035793:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574349.035932:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272290688 00000100:00100000:1.0:1787574349.035943:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272290688 00000100:00080000:0.0:1787574349.036075:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574349.036721:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 156 00000100:00100000:1.0:1787574349.036737:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+35:11431:x1874407272290688:12345-192.168.206.51@tcp:101:stat.0 00010000:00010000:1.0:1787574349.036763:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574349.036786:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c0249 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ed76 expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.036852:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0250 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.036866:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0250 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.036878:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0250 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.036893:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0257 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.036900:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.036927:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.037260:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c025e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.037271:0:7646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c0234 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed6f expref: 36 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.037280:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c025e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.037313:0:7646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c0234 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed6f expref: 36 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.037325:0:7646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c0234 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed6f expref: 36 pid: 5830 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574349.037338:0:7646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98290642a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7646:1874407290118272:192.168.206.51@tcp:104: 00000100:00100000:1.0:1787574349.037446:0:7646:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a069f83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574349.051109:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574349.051903:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272290944 00000100:00100000:3.0:1787574349.051914:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272290944 00000100:00100000:3.0:1787574349.051995:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:3.0:1787574349.052018:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+37:5589:x1874407272290944:12345-192.168.206.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787574349.052841:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+38:5589:x1874407272290944:12345-192.168.206.51@tcp:35:ldlm_bl.0 Request processed in 823us (1737us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1787574349.052852:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:1.0:1787574349.053620:0:7646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98290642a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7646:1874407290118272:192.168.206.51@tcp:104: 00010000:00010000:1.0:1787574349.053659:0:7646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c025e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574349.059385:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574349.059476:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272291072 00000100:00100000:3.0:1787574349.059495:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272291072 00010000:00010000:3.0:1787574349.059535:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c0234 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed6f expref: 38 pid: 5830 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574349.059632:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:3.0:1787574349.059652:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+38:2350:x1874407272291072:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574349.059675:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574349.059683:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c0234 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed6f expref: 38 pid: 5830 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.059698:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c0234 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed6f expref: 38 pid: 5830 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.059719:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbe00/0xfe91058e646c0234 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed6f expref: 38 pid: 5830 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.059752:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:3.0:1787574349.059757:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c025e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.059766:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c025e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.059772:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c025e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.059803:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574349.059861:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+37:2350:x1874407272291072:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 212us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574349.059870:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 67 00010000:00010000:1.0:1787574349.060242:0:7646:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c025e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.060251:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c025e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574349.060306:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787574349.060310:0:7646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787574349.060335:0:7646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c025e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.060349:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c025e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.060358:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0250 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.060365:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0250 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.060372:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0250 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.060378:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574349.060383:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0250 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.060390:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0250 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.060401:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:1.0:1787574349.060404:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574349.060408:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0250 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.060414:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0250 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.060449:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.060455:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0257 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.060461:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0257 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.060466:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1e00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574349.060469:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0257 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.060485:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0257 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.060494:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982a04da2600) 00010000:00010000:1.0:1787574349.060496:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574349.060499:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0257 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.060506:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0257 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.060546:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c0249 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed76 expref: 37 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.060561:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c025e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed76 expref: 36 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.060580:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:1.0:1787574349.060583:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787574349.060586:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0600, rc 0) 00000100:00100000:1.0:1787574349.060633:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+36:11431:x1874407272290688:12345-192.168.206.51@tcp:101:stat.0 Request processed in 23902us (24853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574349.060641:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 156 00000100:00100000:0.0:1787574349.169473:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574349.169644:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272291328 00000100:00100000:2.0:1787574349.169655:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272291328 00000100:00100000:2.0:1787574349.169734:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 157 00000100:00100000:2.0:1787574349.169744:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+36:11437:x1874407272291328:12345-192.168.206.51@tcp:36:truncate.0 00010000:00010000:2.0:1787574349.169817:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574349.169845:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c025e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed76 expref: 36 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.169868:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:2.0:1787574349.169874:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787574349.170087:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646c0265 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.170101:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646c0265 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.170111:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646c0265 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787574349.170159:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1787574349.170233:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009de39f8f reply state 00000000c4148583 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646c0265 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574349.170241:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787574349.170352:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+38:11437:x1874407272291328:12345-192.168.206.51@tcp:36:truncate.0 Request processed in 609us (888us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787574349.170360:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 157 00000020:00080000:2.0:1787574349.170364:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787574349.181285:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646c0265 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.181304:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646c0265 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.181312:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646c0265 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.181318:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069faa00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574349.181323:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646c0265 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.181332:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646c0265 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.181349:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:1.0:1787574349.181353:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574349.181357:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646c0265 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.181364:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069faa00/0xfe91058e646c0265 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574349.334266:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574349.334364:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272291456 00000100:00100000:3.0:1787574349.334375:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272291456 00000100:00100000:3.0:1787574349.334498:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 158 00000100:00100000:3.0:1787574349.334510:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+37:11451:x1874407272291456:12345-192.168.206.51@tcp:101:stat.0 00010000:00010000:3.0:1787574349.334533:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574349.334554:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c026c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ed7d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.334623:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0273 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.334650:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0273 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.334661:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0273 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.334694:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c027a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.334702:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c027a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.334709:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c027a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.335032:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c0281 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.335042:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c0281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.335049:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c0281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574349.335084:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1787574349.335088:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787574349.335105:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c0281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.335116:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c0281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.335123:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0273 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.335129:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0273 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.335146:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0273 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.335153:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574349.335157:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0273 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.335188:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0273 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.335201:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:3.0:1787574349.335204:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574349.335207:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0273 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.335213:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0273 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.335225:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c027a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.335231:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c027a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.335237:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c027a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.335242:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574349.335245:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c027a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.335261:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c027a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.335270:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982a04dc0900) 00010000:00010000:3.0:1787574349.335273:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574349.335276:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c027a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.335282:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c027a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.335314:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c026c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed7d expref: 39 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.335328:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c0281 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed7d expref: 38 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.335335:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:3.0:1787574349.335338:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574349.335340:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142400, rc 0) 00000100:00100000:3.0:1787574349.335407:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+38:11451:x1874407272291456:12345-192.168.206.51@tcp:101:stat.0 Request processed in 899us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574349.335416:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 158 00000100:00100000:0.0:1787574349.416675:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574349.418134:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272291712 00000100:00100000:2.0:1787574349.418148:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272291712 00000100:00100000:2.0:1787574349.419058:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 159 00000100:00100000:2.0:1787574349.419073:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+38:11461:x1874407272291712:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1787574349.419092:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574349.419111:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c0288 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ed84 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574349.419727:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787574349.419875:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c0288 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed84 expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.419890:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34000) 00010000:00010000:2.0:1787574349.419893:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787574349.419897:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c0288 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed84 expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.419909:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fb000, rc 0) 00000100:00100000:2.0:1787574349.419977:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+39:11461:x1874407272291712:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 910us (3314us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787574349.419985:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 159 00000100:00100000:0.0:1787574349.423969:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574349.424076:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272291968 00000100:00100000:2.0:1787574349.424085:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272291968 00000100:00100000:2.0:1787574349.424288:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:2.0:1787574349.424592:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0327f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+39:11461:x1874407272291968:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1787574349.425109:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0327f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+40:11461:x1874407272291968:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 520us (1148us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1787574349.425119:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:0.0:1787574349.500776:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574349.500926:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272292224 00000100:00100000:1.0:1787574349.500938:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272292224 00000100:00100000:1.0:1787574349.501012:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 160 00000100:00100000:1.0:1787574349.501023:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+40:11467:x1874407272292224:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1787574349.501046:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574349.501068:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c0296 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ed8b expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.501215:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c029d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.501231:0:7646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c0281 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed7d expref: 41 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.501239:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c029d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.501275:0:7646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c0281 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed7d expref: 41 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.501289:0:7646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c0281 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed7d expref: 41 pid: 5830 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574349.501314:0:7646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98290642a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7646:1874407290118400:192.168.206.51@tcp:104: 00000100:00100000:1.0:1787574349.501416:0:7646:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a069f83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574349.507607:0:7646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98290642a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7646:1874407290118400:192.168.206.51@tcp:104: 00010000:00010000:1.0:1787574349.507638:0:7646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c029d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574349.508244:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574349.508388:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272292352 00000100:00100000:2.0:1787574349.508398:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272292352 00010000:00010000:2.0:1787574349.508442:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c0281 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed7d expref: 42 pid: 5830 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574349.508485:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:2.0:1787574349.508495:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+42:2350:x1874407272292352:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574349.508511:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574349.508518:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c0281 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed7d expref: 42 pid: 5830 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.508530:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c0281 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed7d expref: 42 pid: 5830 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.508552:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c0281 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed7d expref: 42 pid: 5830 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.508567:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:2.0:1787574349.508572:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c029d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.508581:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c029d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.508606:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c029d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.508624:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574349.508688:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+41:2350:x1874407272292352:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 194us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574349.508695:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 68 00010000:00010000:1.0:1787574349.510337:0:7646:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c029d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.510343:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c029d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574349.510362:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1787574349.510530:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c0296 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed8b expref: 42 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.510550:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c029d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed8b expref: 41 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.510558:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:1.0:1787574349.510561:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787574349.510564:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1e00, rc 0) 00000100:00100000:1.0:1787574349.510630:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+41:11467:x1874407272292224:12345-192.168.206.51@tcp:101:bash.0 Request processed in 9607us (9863us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1787574349.510638:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 160 00000100:00100000:0.0:1787574349.520730:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574349.520823:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272292608 00000100:00100000:2.0:1787574349.520834:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272292608 00000100:00100000:2.0:1787574349.520899:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 161 00000100:00100000:2.0:1787574349.520910:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+41:11467:x1874407272292608:12345-192.168.206.51@tcp:36:bash.0 00010000:00010000:2.0:1787574349.521219:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c02ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.521235:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c02ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.521246:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c02ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787574349.521300:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1787574349.521325:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd3b9837 reply state 00000000a1de5328 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c02ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574349.521334:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787574349.521422:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+44:11467:x1874407272292608:12345-192.168.206.51@tcp:36:bash.0 Request processed in 514us (703us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787574349.521430:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 161 00000020:00080000:2.0:1787574349.521435:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787574349.523713:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c02ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.523728:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c02ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.523736:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c02ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.523742:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fb000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574349.523760:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c02ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.523768:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c02ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.523785:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:1.0:1787574349.523788:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574349.523792:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c02ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.523798:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c02ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574349.540101:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574349.540333:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272292736 00000100:00100000:3.0:1787574349.540344:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272292736 00000100:00100000:3.0:1787574349.540468:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 162 00000100:00100000:3.0:1787574349.540539:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+43:11467:x1874407272292736:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1787574349.540583:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574349.540605:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c02b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ed92 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.540754:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c02b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.540769:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c029d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed8b expref: 44 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.540778:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c02b9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.540810:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c029d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed8b expref: 44 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.540824:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c029d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed8b expref: 44 pid: 7646 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574349.540839:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a418a5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874407290118528:192.168.206.51@tcp:104: 00000100:00100000:3.0:1787574349.540927:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a05c08000 going to sleep for 11 seconds 00000100:00100000:0.0:1787574349.544752:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574349.545045:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272292864 00000100:00100000:3.0:1787574349.545055:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272292864 00010000:00010000:3.0:1787574349.545094:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c029d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed8b expref: 45 pid: 7646 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574349.545138:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:3.0:1787574349.545148:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+45:2351:x1874407272292864:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574349.545225:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574349.545233:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c029d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed8b expref: 45 pid: 7646 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.545247:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c029d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed8b expref: 45 pid: 7646 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.545267:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:3.0:1787574349.545273:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c02b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.545282:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c02b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.545290:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c02b9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.545307:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574349.545352:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+45:2351:x1874407272292864:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 205us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574349.545360:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 69 00010000:00010000:2.0:1787574349.547548:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c029d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed8b expref: 44 pid: 7646 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574349.547575:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a418a5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874407290118528:192.168.206.51@tcp:104: 00010000:00010000:2.0:1787574349.547598:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c02b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.547608:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c02b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.547614:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c02b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574349.549602:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787574349.549613:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787574349.549658:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c02b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.549722:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c02b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed92 expref: 44 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.549744:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c02b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed92 expref: 43 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.549754:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:2.0:1787574349.549757:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574349.549760:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142200, rc 0) 00000100:00100000:2.0:1787574349.549835:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+43:11467:x1874407272292736:12345-192.168.206.51@tcp:101:bash.0 Request processed in 9357us (9743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574349.549843:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 162 00010000:00010000:0.0:1787574349.553512:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574349.554490:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574349.554626:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272293120 00000100:00100000:2.0:1787574349.554646:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272293120 00000100:00100000:2.0:1787574349.554700:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:2.0:1787574349.554711:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+43:11467:x1874407272293120:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:2.0:1787574349.554977:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+44:11467:x1874407272293120:12345-192.168.206.51@tcp:35:bash.0 Request processed in 267us (492us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1787574349.554985:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:3.0:1787574349.651567:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574349.651829:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272293376 00000100:00100000:2.0:1787574349.651843:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272293376 00000100:00100000:2.0:1787574349.651935:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 163 00000100:00100000:2.0:1787574349.651949:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+44:11478:x1874407272293376:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1787574349.651982:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574349.652020:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c02c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ed99 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574349.652395:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787574349.652619:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c02c0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed99 expref: 46 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.652641:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34000) 00010000:00010000:2.0:1787574349.652645:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787574349.652652:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c02c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed99 expref: 46 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.653513:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fb200, rc 0) 00000100:00100000:2.0:1787574349.653798:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+45:11478:x1874407272293376:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1848us (2243us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1787574349.653825:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 163 00000100:00100000:1.0:1787574349.669345:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574349.669448:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272293504 00000100:00100000:0.0:1787574349.669461:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272293504 00000100:00100000:0.0:1787574349.669584:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 164 00000100:00100000:0.0:1787574349.669598:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98290642a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+45:11478:x1874407272293504:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:0.0:1787574349.669703:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c02ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.669724:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c02ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.669737:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c02ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.669771:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c02d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.669779:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c02d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.669786:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c02d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670159:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c02dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670225:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c02dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670234:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c02dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574349.670285:0:7646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c02dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670300:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c02ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670307:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c02ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670315:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c02ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670321:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01e00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574349.670326:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c02ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670340:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c02ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670356:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:0.0:1787574349.670359:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574349.670366:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c02ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670373:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c02ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670388:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c02d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670395:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c02d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670401:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c02d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670406:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574349.670409:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c02d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670415:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c02d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670423:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982a0de1d500) 00010000:00010000:0.0:1787574349.670426:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574349.670428:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c02d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670445:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c02d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670460:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c02dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670467:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c02dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670473:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c02dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670478:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00e00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574349.670482:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c02dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670488:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c02dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670496:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:0.0:1787574349.670498:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574349.670502:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c02dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.670508:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c02dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574349.670612:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98290642a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+45:11478:x1874407272293504:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 1014us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574349.670622:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 164 00000100:00100000:3.0:1787574349.673683:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574349.674831:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272293760 00000100:00100000:2.0:1787574349.674846:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272293760 00000100:00100000:2.0:1787574349.674933:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:2.0:1787574349.674944:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+45:11478:x1874407272293760:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1787574349.675498:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+46:11478:x1874407272293760:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 553us (1833us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787574349.675507:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:3.0:1787574349.728578:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574349.728712:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272294016 00000100:00100000:1.0:1787574349.728724:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272294016 00000100:00100000:1.0:1787574349.728800:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 165 00000100:00100000:1.0:1787574349.728813:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+46:11481:x1874407272294016:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1787574349.728846:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574349.728872:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646c02e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eda0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.728987:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c02ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.729017:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c02ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.729037:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c02ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.729077:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c02f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.729085:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c02f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.729092:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c02f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.731431:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c02f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.731470:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c02f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.731492:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c02f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574349.731518:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787574349.731869:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c02ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.731882:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c02ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.731890:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c02ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.731900:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574349.731909:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c02ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.731945:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c02ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.731965:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:1.0:1787574349.731969:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574349.731977:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c02ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.731983:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c02ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.732069:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c02f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.732079:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c02f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.732086:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c02f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.732091:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574349.732093:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c02f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.732099:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c02f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.732106:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982a04da2600) 00010000:00010000:1.0:1787574349.732109:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574349.732112:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c02f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.732128:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c02f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.732727:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646c02e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eda0 expref: 49 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.733148:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c02f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eda0 expref: 48 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574349.733159:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:1.0:1787574349.733162:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787574349.733201:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1c00, rc 0) 00000100:00100000:1.0:1787574349.733520:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+48:11481:x1874407272294016:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 4706us (4952us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1787574349.733530:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 165 00000100:00100000:1.0:1787574349.741625:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574349.741800:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574349.742734:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272294272 00000100:00100000:3.0:1787574349.742752:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272294272 00000100:00100000:3.0:1787574349.742839:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 166 00000100:00100000:3.0:1787574349.742853:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982906429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+48:11481:x1874407272294272:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:3.0:1787574349.742969:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0306 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.742988:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0306 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.743017:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0306 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.743053:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0306 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.743060:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0306 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.743066:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0306 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.743072:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574349.743077:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0306 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.743086:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0306 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.743100:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:3.0:1787574349.743103:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787574349.743108:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0306 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574349.743115:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0306 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574349.743271:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982906429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+48:11481:x1874407272294272:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 420us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574349.743281:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 166 00000100:00100000:3.0:1787574349.746008:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574349.746118:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272294528 00000100:00100000:0.0:1787574349.746131:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272294528 00000100:00100000:0.0:1787574349.746232:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:0.0:1787574349.746246:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+48:11481:x1874407272294528:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1787574349.746789:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+49:11481:x1874407272294528:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 544us (807us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1787574349.746800:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:2.0:1787574349.748857:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272294144 00000100:00100000:2.0:1787574349.748879:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272294144 00000100:00100000:2.0:1787574349.748974:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:2.0:1787574349.748987:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982906428e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+49:2350:x1874407272294144:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574349.749020:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574349.749055:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c02f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eda0 expref: 49 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.749079:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:2.0:1787574349.749086:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574349.749194:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982906428e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+48:2350:x1874407272294144:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 209us (7585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574349.749202:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:1.0:1787574349.971161:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574349.971626:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272294784 00000100:00100000:2.0:1787574349.971642:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272294784 00000100:00100000:2.0:1787574349.971726:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 167 00000100:00100000:2.0:1787574349.971741:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982906429180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+48:11499:x1874407272294784:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:2.0:1787574349.971800:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574349.971830:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c030d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eda7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.971979:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0314 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.974801:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0314 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574349.974836:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0314 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574349.974864:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787574349.975188:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c030d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eda7 expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.975215:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0314 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eda7 expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574349.975225:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:0.0:1787574349.975228:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787574349.975232:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fa400, rc 0) 00000100:00100000:0.0:1787574349.975733:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982906429180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+50:11499:x1874407272294784:12345-192.168.206.51@tcp:101:cat.0 Request processed in 3991us (4584us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1787574349.975745:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 167 00000100:00100000:0.0:1787574350.012025:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574350.013354:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272294912 00000100:00100000:3.0:1787574350.013375:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272294912 00000100:00100000:3.0:1787574350.013466:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 168 00000100:00100000:3.0:1787574350.013478:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+50:11500:x1874407272294912:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1787574350.013511:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574350.013540:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0322 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1edae expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.013627:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c0329 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.013644:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c0329 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.013657:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c0329 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574350.013906:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787574350.013912:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787574350.013992:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c0329 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.014047:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0322 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edae expref: 52 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.014091:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c0329 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edae expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.014101:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:3.0:1787574350.016966:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574350.016981:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16143a00, rc 0) 00000100:00100000:2.0:1787574350.018912:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+51:11500:x1874407272294912:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 5418us (6884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574350.018928:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 168 00000100:00100000:3.0:1787574350.025842:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574350.027159:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272295296 00000100:00100000:2.0:1787574350.027216:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272295296 00000100:00100000:2.0:1787574350.027299:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:2.0:1787574350.027323:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+51:11500:x1874407272295296:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1787574350.027764:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+52:11500:x1874407272295296:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 442us (1934us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787574350.027774:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:1.0:1787574350.031239:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574350.031490:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272295424 00000100:00100000:3.0:1787574350.031504:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272295424 00000100:00100000:3.0:1787574350.031585:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:3.0:1787574350.031598:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a063abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+52:11500:x1874407272295424:12345-192.168.206.51@tcp:103:lfs.0 00010000:00010000:3.0:1787574350.031617:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787574350.031652:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c02b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed92 expref: 52 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.031679:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0314 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eda7 expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.031694:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646c01c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed53 expref: 50 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.031705:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2f00) 00010000:00010000:3.0:1787574350.031718:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574350.031797:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a063abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+49:11500:x1874407272295424:12345-192.168.206.51@tcp:103:lfs.0 Request processed in 201us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574350.031825:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1787574350.040025:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574350.040244:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272295552 00000100:00100000:0.0:1787574350.040258:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272295552 00000100:00100000:0.0:1787574350.040347:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 169 00000100:00100000:0.0:1787574350.040361:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98290642b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+49:11500:x1874407272295552:12345-192.168.206.51@tcp:58:lfs.0 00010000:00010000:0.0:1787574350.040537:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c0330 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.040582:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c0330 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.040597:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c0330 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787574350.040839:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787574350.040966:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98290642b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+49:11500:x1874407272295552:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 607us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574350.040977:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 169 00000100:00100000:1.0:1787574350.081288:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574350.081397:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272295680 00000100:00100000:0.0:1787574350.081414:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272295680 00000100:00100000:0.0:1787574350.081492:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 170 00000100:00100000:0.0:1787574350.081504:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982906429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+49:11502:x1874407272295680:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1787574350.081532:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574350.081559:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c0337 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1edb5 expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.081651:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c033e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.081681:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c033e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.081694:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c033e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.081710:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0345 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.081738:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0345 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.081745:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0345 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.082102:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c034c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.082112:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c034c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.082119:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c034c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574350.082211:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787574350.082216:0:7646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787574350.082242:0:7646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c034c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.082256:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c034c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.082265:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c033e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.082271:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c033e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.082278:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c033e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.082307:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01e00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574350.082313:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c033e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.082321:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c033e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.082337:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:0.0:1787574350.082340:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574350.082345:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c033e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.082351:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c033e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.082365:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0345 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.082370:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0345 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.082376:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0345 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.082381:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00800 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574350.082384:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0345 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.082390:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0345 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.082410:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982a0de1da00) 00010000:00010000:0.0:1787574350.082412:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574350.082415:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0345 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.082420:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0345 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.082460:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c0337 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edb5 expref: 51 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.082474:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c034c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edb5 expref: 50 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.082483:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a0de1d500) 00010000:00010000:0.0:1787574350.082485:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787574350.082488:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a41d01000, rc 0) 00000100:00100000:0.0:1787574350.082564:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982906429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+50:11502:x1874407272295680:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1061us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574350.082573:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 170 00000040:00080000:3.0:1787574350.257626:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787574350.257636:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787574350.257694:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1787574350.257701:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787574350.257860:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b4700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874407290118656:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787574350.258004:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a05c08b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787574350.272114:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574350.272222:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272295808 00000100:00100000:0.0:1787574350.272234:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272295808 00000100:00100000:0.0:1787574350.272315:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 171 00000100:00100000:0.0:1787574350.272329:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98290642b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+51:11513:x1874407272295808:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787574350.272371:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787574350.272502:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98290642b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+51:11513:x1874407272295808:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 175us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574350.272522:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 171 00000100:00100000:3.0:1787574350.277340:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b4700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874407290118656:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787574350.280509:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574350.280610:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272295936 00000100:00100000:2.0:1787574350.280623:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272295936 00000100:00100000:2.0:1787574350.280701:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 172 00000100:00100000:2.0:1787574350.280713:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982906429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+50:11513:x1874407272295936:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787574350.280824:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c0353 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.280844:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c0353 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.280857:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c0353 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281032:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c035a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281054:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c035a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281067:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c035a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281112:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0361 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281122:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281129:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574350.281240:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787574350.281246:0:7646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787574350.281262:0:7646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281275:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c0353 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281298:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c0353 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281305:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c0353 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281312:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fba00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574350.281317:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c0353 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281324:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c0353 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281337:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982a04da2c00) 00010000:00010000:2.0:1787574350.281340:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574350.281345:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c0353 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281351:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c0353 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281367:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c035a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281373:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c035a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281379:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c035a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281383:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fb600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574350.281394:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c035a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281401:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c035a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281408:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff982a03b34300) 00010000:00010000:2.0:1787574350.281410:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574350.281412:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c035a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281418:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c035a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281433:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281439:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0361 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281444:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0361 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281449:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fa600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574350.281451:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0361 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281457:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0361 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281468:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a0de1d500) 00010000:00010000:2.0:1787574350.281470:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574350.281477:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0361 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.281483:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0361 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574350.281567:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982906429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+50:11513:x1874407272295936:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 854us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574350.281576:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 172 00000100:00100000:1.0:1787574350.287536:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574350.287617:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272296192 00000100:00100000:2.0:1787574350.287634:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272296192 00000100:00100000:2.0:1787574350.287710:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 173 00000100:00100000:2.0:1787574350.287721:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98290642a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+50:11513:x1874407272296192:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787574350.287742:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574350.287762:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c0368 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1edbc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.287863:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c036f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.287878:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c036f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.287890:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c036f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574350.287903:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787574350.288018:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c036f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.288026:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c036f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.288046:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c036f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.288052:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fac00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574350.288056:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c036f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.288064:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c036f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.288077:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a0de1d500) 00010000:00010000:2.0:1787574350.288080:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787574350.288084:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c036f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.288090:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c036f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.289202:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c0368 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edbc expref: 52 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.289215:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982a04da2c00) 00010000:00010000:2.0:1787574350.289218:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787574350.289222:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c0368 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edbc expref: 52 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.289302:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fb400, rc 0) 00000100:00100000:2.0:1787574350.289369:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98290642a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+51:11513:x1874407272296192:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1649us (1850us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1787574350.289391:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 173 00000100:00100000:1.0:1787574350.293396:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574350.294206:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272296320 00000100:00100000:3.0:1787574350.294216:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272296320 00000100:00100000:3.0:1787574350.294280:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 174 00000100:00100000:3.0:1787574350.294289:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982906429500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+51:11513:x1874407272296320:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787574350.294319:0:5830:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787574350.294412:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982906429500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+51:11513:x1874407272296320:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 124us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574350.294421:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 174 00000100:00100000:1.0:1787574350.303442:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574350.303539:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272296576 00000100:00100000:0.0:1787574350.303557:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272296576 00000100:00100000:0.0:1787574350.303654:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 175 00000100:00100000:0.0:1787574350.303667:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982906428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+51:11513:x1874407272296576:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574350.303696:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574350.303700:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787574350.303735:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c0329 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edae expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.303762:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:0.0:1787574350.303779:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574350.303797:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c037d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1edc3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787574350.304844:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787574350.305276:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c0384 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.305295:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c0384 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.305309:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c0384 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.305388:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c037d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edc3 expref: 53 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.305429:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c0384 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edc3 expref: 52 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.305439:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982a0de1da00) 00010000:00010000:0.0:1787574350.305443:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574350.305446:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a41d01e00, rc 0) 00000100:00100000:0.0:1787574350.305543:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982906428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+52:11513:x1874407272296576:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1877us (2107us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787574350.305553:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 175 00000100:00100000:1.0:1787574350.309827:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574350.310580:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272296832 00000100:00100000:3.0:1787574350.310589:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272296832 00000100:00100000:3.0:1787574350.310643:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 176 00000100:00100000:3.0:1787574350.310652:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98290642ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+52:11513:x1874407272296832:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787574350.310721:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574350.310752:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c0384 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edc3 expref: 52 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.310773:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982a0de1da00) 00010000:00010000:3.0:1787574350.310795:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574350.310821:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0392 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.310834:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0392 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.310844:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0392 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.313933:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0399 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa201cae4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.313955:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0399 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa201cae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.313966:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0399 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa201cae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.314848:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0392 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.314860:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0392 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.314867:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0392 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.314873:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574350.314878:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0392 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.314885:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0392 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.314914:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:3.0:1787574350.314917:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574350.314922:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0392 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.314928:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0392 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.314942:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0399 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa201cae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.314949:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0399 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa201cae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.314956:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0399 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa201cae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.314961:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574350.314964:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0399 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa201cae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.314971:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0399 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa201cae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.314979:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa201cae4 (ffff982a04dc0900) 00010000:00010000:3.0:1787574350.314981:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574350.314983:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0399 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa201cae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.314989:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0399 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa201cae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574350.315130:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98290642ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+51:11513:x1874407272296832:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 4473us (5307us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787574350.315397:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 176 00000100:00100000:1.0:1787574350.319751:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574350.319848:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272296960 00000100:00100000:2.0:1787574350.319858:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272296960 00000100:00100000:2.0:1787574350.319920:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 177 00000100:00100000:2.0:1787574350.319930:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982906428000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+51:11513:x1874407272296960:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787574350.319949:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574350.319972:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1edca expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.320018:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c03a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.320031:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c03a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.320042:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c03a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.320152:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edca expref: 53 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.320205:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c03a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edca expref: 52 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.320215:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982a03b34300) 00010000:00010000:2.0:1787574350.320218:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787574350.320221:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fac00, rc 0) 00000100:00100000:2.0:1787574350.320293:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982906428000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+52:11513:x1874407272296960:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 363us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574350.320309:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 177 00000100:00100000:1.0:1787574350.325613:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574350.325706:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272297216 00000100:00100000:2.0:1787574350.325717:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272297216 00000100:00100000:2.0:1787574350.325774:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 178 00000100:00100000:2.0:1787574350.325786:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982906428e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+52:11513:x1874407272297216:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787574350.325876:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c03ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.325892:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c03ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.325904:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c03ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787574350.326273:0:7646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1787574350.326285:0:7646:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 326501118162ns, next at 327501115525ns, rc = 0 00000004:00010000:2.0:1787574350.326405:0:7646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2671739 reply state 000000004e35e1d4 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c03ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574350.326416:0:7646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787574350.326509:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982906428e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+54:11513:x1874407272297216:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 724us (905us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1787574350.326516:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 178 00010000:00010000:1.0:1787574350.329502:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c03ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574350.329525:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c03ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574350.329535:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c03ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574350.329542:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fa600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574350.329548:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c03ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574350.329557:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c03ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574350.329579:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982a03b34300) 00010000:00010000:1.0:1787574350.329583:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787574350.329589:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c03ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574350.329597:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c03ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574350.331400:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574350.331524:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272297344 00000100:00100000:3.0:1787574350.331540:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272297344 00000100:00100000:3.0:1787574350.331661:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 179 00000100:00100000:3.0:1787574350.331673:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98290642bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+53:11513:x1874407272297344:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574350.331697:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574350.331721:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c03b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1edd1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.331791:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c03b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edd1 expref: 54 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.331807:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c03b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edd1 expref: 54 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.331830:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982a03b34300) 00010000:00010000:3.0:1787574350.331834:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574350.331838:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142600, rc 0) 00000100:00100000:3.0:1787574350.331920:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98290642bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+54:11513:x1874407272297344:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 247us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574350.331929:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 179 00000100:00100000:0.0:1787574350.362613:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574350.362723:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272297472 00000100:00100000:3.0:1787574350.362736:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272297472 00000100:00100000:3.0:1787574350.362816:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:3.0:1787574350.362844:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2351:x1874407272297472:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787574350.363246:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2351:x1874407272297472:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 404us (647us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787574350.363254:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00080000:0.0:1787574350.366804:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574350.379155:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574350.379311:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272297728 00000100:00100000:0.0:1787574350.379321:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272297728 00000100:00100000:0.0:1787574350.379377:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:0.0:1787574350.379388:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+54:11513:x1874407272297728:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787574350.379622:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+55:11513:x1874407272297728:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 235us (475us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1787574350.379630:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:3.0:1787574350.394620:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574350.394699:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272297984 00000100:00100000:2.0:1787574350.394708:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272297984 00000100:00100000:2.0:1787574350.394766:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 180 00000100:00100000:2.0:1787574350.394775:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+55:11513:x1874407272297984:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787574350.394888:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+55:11513:x1874407272297984:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 114us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574350.394896:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 180 00000100:00100000:2.0:1787574350.400940:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574350.401029:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272298112 00000100:00100000:3.0:1787574350.401037:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272298112 00000100:00100000:3.0:1787574350.401091:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 181 00000100:00100000:3.0:1787574350.401101:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+55:11513:x1874407272298112:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574350.401122:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574350.401142:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c03bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1edd8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.401231:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c03c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.401244:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c03c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.401255:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c03c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574350.401289:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787574350.401304:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c03c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.401328:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c03bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edd8 expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.401365:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c03c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edd8 expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.401374:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982a03b34300) 00010000:00010000:3.0:1787574350.401377:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787574350.401380:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142400, rc 0) 00000100:00100000:3.0:1787574350.401428:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+56:11513:x1874407272298112:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 329us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574350.401435:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 181 00000100:00100000:1.0:1787574350.405515:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574350.405616:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272298240 00000100:00100000:0.0:1787574350.405625:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272298240 00000100:00100000:0.0:1787574350.405689:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:0.0:1787574350.405699:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2352:x1874407272298240:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574350.405715:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574350.405735:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008864d6ad/0xfe91058e646c03ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eddf expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787574350.405782:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c384e, blocks: 0x1 00010000:00010000:0.0:1787574350.405799:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=326s v=(0 0) 00010000:00010000:0.0:1787574350.405804:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574350.405813:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008864d6ad/0xfe91058e646c03ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eddf expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.405832:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008864d6ad/0xfe91058e646c03ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eddf expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.405845:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a41d01800, rc 0) 00000100:00100000:0.0:1787574350.405907:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2352:x1874407272298240:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 209us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574350.405914:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:0.0:1787574350.415010:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574350.415115:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272298496 00000100:00100000:2.0:1787574350.415124:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272298496 00000100:00100000:2.0:1787574350.415220:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 182 00000100:00100000:2.0:1787574350.415231:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+56:11513:x1874407272298496:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787574350.415322:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+56:11513:x1874407272298496:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 94us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574350.415329:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 182 00000100:00100000:2.0:1787574350.418855:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574350.418940:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272298624 00000100:00100000:3.0:1787574350.418949:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272298624 00000100:00100000:3.0:1787574350.419013:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:3.0:1787574350.419023:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:11513:x1874407272298624:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574350.419040:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574350.419058:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c03d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ede6 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.419087:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008864d6ad/0xfe91058e646c03ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eddf expref: 9 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.419095:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574350.419099:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574350.419104:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c03d1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ede6 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.419152:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008864d6ad/0xfe91058e646c03ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eddf expref: 9 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.419209:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008864d6ad/0xfe91058e646c03ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eddf expref: 9 pid: 6683 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574350.419225:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1874407290118784:192.168.206.51@tcp:104: 00000100:00100000:3.0:1787574350.419313:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a05c083c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574350.422576:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574350.422706:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272298752 00000100:00100000:2.0:1787574350.422714:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272298752 00010000:00010000:2.0:1787574350.422748:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008864d6ad/0xfe91058e646c03ca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eddf expref: 10 pid: 6683 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574350.422793:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:2.0:1787574350.422802:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+10:2350:x1874407272298752:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574350.422813:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574350.422832:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008864d6ad/0xfe91058e646c03ca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eddf expref: 10 pid: 6683 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.422845:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008864d6ad/0xfe91058e646c03ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eddf expref: 10 pid: 6683 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.422892:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574350.422896:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574350.422904:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c03d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ede6 expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.422914:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c03d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ede6 expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.422947:0:5815:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c03d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ede6 expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574350.422960:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5815:1874407290118912:192.168.206.51@tcp:105: 00000100:00100000:2.0:1787574350.423040:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a06668840 going to sleep for 11 seconds 00010000:00010000:3.0:1787574350.423199:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008864d6ad/0xfe91058e646c03ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eddf expref: 10 pid: 6683 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574350.423215:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1874407290118784:192.168.206.51@tcp:104: 00010000:00010000:3.0:1787574350.423238:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c03d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ede6 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.423249:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142200, rc 0) 00000100:00100000:3.0:1787574350.423274:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:11513:x1874407272298624:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 4253us (4429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574350.423281:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:2.0:1787574350.427417:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5815:1874407290118912:192.168.206.51@tcp:105: 00010000:00010000:2.0:1787574350.427455:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574350.427523:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2350:x1874407272298752:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 4719us (4953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574350.427533:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:1.0:1787574350.429795:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574350.429900:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272298880 00000100:00100000:0.0:1787574350.429910:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272298880 00002000:00100000:0.0:1787574350.429959:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff982a41d72300 x1874407272298880/t0(0) o4->a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp:121/0 lens 504/0 e 0 to 0 dl 1787574361 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787574350.429971:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a41d72300 with x1874407272298880 ext(0->8) 00002000:00010000:0.0:1787574350.429977:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff982a41d72300 00000100:00100000:0.0:1787574350.430019:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:0.0:1787574350.430029:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2351:x1874407272298880:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787574350.430750:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+10:2351:x1874407272298880:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 718us (960us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787574350.430766:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00002000:00100000:0.0:1787574350.430774:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff982a41d72300 x1874407272298880/t4294967314(0) o4->a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp:121/0 lens 504/448 e 0 to 0 dl 1787574361 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787574350.430783:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a41d72300 with x1874407272298880 ext(0->8) 00002000:00010000:0.0:1787574350.430788:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff982a41d72300 00000100:00100000:3.0:1787574350.433976:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574350.434139:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272299008 00000100:00100000:2.0:1787574350.434148:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272299008 00000100:00100000:2.0:1787574350.434247:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 183 00000100:00100000:2.0:1787574350.434258:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+56:11513:x1874407272299008:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787574350.490602:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+56:11513:x1874407272299008:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 56335us (56624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574350.490626:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 183 00000001:00080000:1.0:1787574350.490665:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1787574350.490713:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787574350.490733:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff982a26fc6180 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787574350.490737:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982a06922f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff982a26fc6a80 00000020:00080000:1.0:1787574350.490741:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982a4145f100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff982a41707400 00000004:00080000:1.0:1787574350.490766:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:1.0:1787574350.494300:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982905b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290119040:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787574350.494386:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574350.494454:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574350.494461:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290119168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787574350.494486:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574350.494522:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290119040 00000100:00100000:1.0:1787574350.494529:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290119040 00000100:00100000:1.0:1787574350.494580:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290119168 00000100:00100000:1.0:1787574350.494583:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290119168 00000020:00080000:3.0:1787574350.494590:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:1.0:1787574350.494608:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787574350.494615:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982905b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290119040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787574350.494642:0:6683:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1787574350.494672:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8c384b, atime: 0x6a8c384b, ctime: 0x6a8c384b, blocks: 0xb 00010000:00010000:1.0:1787574350.494680:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c3fa431/0xfe91058e646c03d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574350.494694:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=326s v=(0 0) 00010000:00010000:1.0:1787574350.494698:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574350.494703:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c3fa431/0xfe91058e646c03d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574350.494726:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c3fa431/0xfe91058e646c03d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574350.494737:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c3fa431/0xfe91058e646c03d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574350.494744:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c3fa431/0xfe91058e646c03d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574350.494759:0:6683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:3.0:1787574350.494785:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787574350.495324:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982905b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1874407290119040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 707us (938us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787574350.495332:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787574350.495352:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787574350.495360:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982905b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290119168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787574350.495463:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787574350.495467:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787574350 00002000:00010000:1.0:1787574350.495469:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787574350.495471:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787574350 -> 1787574350 00002000:00010000:1.0:1787574350.495474:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787574350.495503:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982905b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1874407290119168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 144us (1015us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787574350.495510:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787574350.495535:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787574350.495539:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787574350.495560:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574350.495567:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c3fa431/0xfe91058e646c03d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574350.495575:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0800 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574350.495580:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c3fa431/0xfe91058e646c03d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574350.495590:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c3fa431/0xfe91058e646c03d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574350.495609:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c3fa431/0xfe91058e646c03d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574350.495617:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c3fa431/0xfe91058e646c03d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574350.495633:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574350.495635:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574350.495637:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787574350.495813:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982a3a8ab100/2, rc 0, transno 4294967315 00000100:00100000:3.0:1787574350.495825:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290119168:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787574350.495838:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1787574350.495843:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1787574350.495862:0:3300:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff982905b5a680 x1874407290119040/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787574366 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787574350.495870:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982905b5a680/2, rc 0, transno 4294967307 00000100:00100000:3.0:1787574350.495873:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982905b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290119040:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787574350.496655:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574350.499188:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272299136 00000100:00100000:1.0:1787574350.499202:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272299136 00000100:00100000:1.0:1787574350.499259:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:1.0:1787574350.499268:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+10:2353:x1874407272299136:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787574350.562153:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:0.0:1787574350.562194:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1787574350.562844:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2353:x1874407272299136:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 63569us (66187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574350.562855:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:1.0:1787574350.576245:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574350.576292:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272299392 00000100:00100000:2.0:1787574350.576302:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272299392 00000100:00100000:2.0:1787574350.576369:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 184 00000100:00100000:2.0:1787574350.576381:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982905b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+18:11513:x1874407272299392:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787574350.576430:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574350.576458:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c03c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edd8 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.576476:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982a03b34300) 00010000:00010000:2.0:1787574350.576480:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787574350.576507:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03df lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.576520:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.576529:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787574350.576860:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea52a518 reply state 00000000d76abbf0 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574350.576870:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787574350.576971:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982905b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:11513:x1874407272299392:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 591us (1542us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1787574350.576978:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 184 00010000:00010000:0.0:1787574350.580392:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574350.584227:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574350.584466:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272299520 00000100:00100000:0.0:1787574350.584486:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272299520 00000100:00100000:0.0:1787574350.584549:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:0.0:1787574350.584559:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982905b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2350:x1874407272299520:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787574350.585130:0:8472:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787574350.585135:0:8472:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787574350 -> 1787574349 00002000:00010000:0.0:1787574350.585138:0:8472:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787574347 00002000:00010000:0.0:1787574350.585140:0:8472:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787574350 -> 1787574349 00002000:00010000:0.0:1787574350.585142:0:8472:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787574350.585233:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982905b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2350:x1874407272299520:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 674us (1026us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787574350.585242:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 56 00010000:00010000:2.0:1787574350.586288:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.586302:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.586326:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.586332:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fb400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574350.586337:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.586344:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.586360:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982a03b34300) 00010000:00010000:2.0:1787574350.586363:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574350.586368:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03df lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.586374:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03df lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574350.588743:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574350.588831:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272299776 00000100:00100000:0.0:1787574350.588841:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272299776 00000100:00100000:0.0:1787574350.588901:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 185 00000100:00100000:0.0:1787574350.588911:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982905b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+18:11513:x1874407272299776:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787574350.588978:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c03e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.589013:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c03a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edca expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.589022:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c03e6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.589060:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c03a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edca expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.589074:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c03a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edca expref: 18 pid: 5831 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574350.589088:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874407290119296:192.168.206.51@tcp:104: 00000100:00100000:0.0:1787574350.589184:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0828ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574350.594151:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574350.594212:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272299904 00000100:00100000:0.0:1787574350.594221:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272299904 00010000:00010000:0.0:1787574350.594263:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c03a7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edca expref: 19 pid: 5831 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574350.594297:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:0.0:1787574350.594307:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:2350:x1874407272299904:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574350.594322:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574350.594329:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c03a7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edca expref: 19 pid: 5831 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.594357:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c03a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edca expref: 19 pid: 5831 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.594379:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982a03b34300) 00010000:00010000:0.0:1787574350.594385:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c03e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.594393:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c03e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.594400:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c03e6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.594418:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574350.594483:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:2350:x1874407272299904:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 177us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574350.594490:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 71 00010000:00010000:0.0:1787574350.594595:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c03a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edca expref: 18 pid: 5831 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574350.594609:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874407290119296:192.168.206.51@tcp:104: 00010000:00010000:0.0:1787574350.594626:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c03e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.594634:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c03e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.594639:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c03e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.594679:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c03e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.594686:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c03e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.594693:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c03e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.594699:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574350.594702:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c03e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.594710:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c03e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.594718:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982a03b34300) 00010000:00010000:0.0:1787574350.594721:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787574350.594725:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c03e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.594729:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01c00/0xfe91058e646c03e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574350.594770:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982905b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+17:11513:x1874407272299776:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 5860us (6037us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787574350.594778:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 185 00000100:00100000:0.0:1787574350.611096:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574350.611248:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272300032 00000100:00100000:3.0:1787574350.611258:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272300032 00000100:00100000:3.0:1787574350.611310:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:3.0:1787574350.611322:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2351:x1874407272300032:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787574350.611365:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008eae6976/0xfe91058e646c03ed lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.611385:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c03d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ede6 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.611394:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574350.611398:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787574350.611403:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008eae6976/0xfe91058e646c03ed lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.611437:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c03d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ede6 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.611479:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c03d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ede6 expref: 8 pid: 6681 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574350.611494:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6682:1874407290119424:192.168.206.51@tcp:104: 00000100:00100000:3.0:1787574350.611568:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a2e0fdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787574350.615516:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6682:1874407290119424:192.168.206.51@tcp:104: 00010000:00010000:3.0:1787574350.615546:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008eae6976/0xfe91058e646c03ed lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574350.619128:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574350.620754:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272300160 00000100:00100000:3.0:1787574350.620771:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272300160 00010000:00010000:3.0:1787574350.620831:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c03d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ede6 expref: 9 pid: 6681 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574350.620889:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:3.0:1787574350.620901:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:2350:x1874407272300160:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574350.620918:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574350.620944:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c03d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ede6 expref: 9 pid: 6681 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.620958:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c03d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ede6 expref: 9 pid: 6681 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.620984:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c03d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ede6 expref: 9 pid: 6681 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.621034:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787574350.621040:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787574350.621046:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008eae6976/0xfe91058e646c03ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.621056:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008eae6976/0xfe91058e646c03ed lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.621087:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574350.621156:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2350:x1874407272300160:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 256us (2037us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574350.621188:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00010000:00010000:3.0:1787574350.621223:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008eae6976/0xfe91058e646c03ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.621232:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008eae6976/0xfe91058e646c03ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.621257:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008eae6976/0xfe91058e646c03ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.621266:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008eae6976/0xfe91058e646c03ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.621273:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008eae6976/0xfe91058e646c03ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.621290:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16143000 already unused, calling callback (ffffffffc142f230) 00010000:00010000:3.0:1787574350.621294:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008eae6976/0xfe91058e646c03ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.621303:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008eae6976/0xfe91058e646c03ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.621314:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008eae6976/0xfe91058e646c03ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.621321:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008eae6976/0xfe91058e646c03ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574350.621368:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2351:x1874407272300032:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 10049us (10281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574350.621376:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:0.0:1787574350.625258:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574350.625362:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272300416 00000100:00100000:2.0:1787574350.625372:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272300416 00000100:00100000:2.0:1787574350.625442:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 186 00000100:00100000:2.0:1787574350.625454:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+17:11513:x1874407272300416:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787574350.625541:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.625558:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.625570:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.625798:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c03fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.625809:0:7646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c03b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edd1 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.625817:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c03fb lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.625849:0:7646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c03b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edd1 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574350.625862:0:7646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c03b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edd1 expref: 18 pid: 5831 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574350.625876:0:7646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3ad35f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7646:1874407290119552:192.168.206.51@tcp:104: 00000100:00100000:2.0:1787574350.625956:0:7646:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a066680c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574350.629750:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574350.629958:0:7646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3ad35f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7646:1874407290119552:192.168.206.51@tcp:104: 00010000:00010000:3.0:1787574350.629987:0:7646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c03fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574350.637796:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272300544 00000100:00100000:0.0:1787574350.637820:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272300544 00010000:00010000:0.0:1787574350.638146:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c03b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edd1 expref: 19 pid: 5831 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574350.639123:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:0.0:1787574350.639136:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:2351:x1874407272300544:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574350.639154:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574350.639183:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c03b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edd1 expref: 19 pid: 5831 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.639201:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c03b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edd1 expref: 19 pid: 5831 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.639227:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c03b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edd1 expref: 19 pid: 5831 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.639244:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982a03b34300) 00010000:00010000:0.0:1787574350.639250:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c03fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.639260:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c03fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.639267:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c03fb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.639295:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574350.639360:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+18:2351:x1874407272300544:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 227us (9619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574350.639384:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00010000:00010000:0.0:1787574350.639413:0:7646:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c03fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.639421:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c03fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787574350.639634:0:7646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1787574350.639929:0:7646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1787574350.639975:0:7646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1787574350.640069:0:7646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7646:1874407290119680:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787574350.640131:0:7646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574350.640162:0:7646:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a064c3180 going to sleep for 11 seconds 00000100:00100000:0.0:1787574350.640205:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290119680 00000100:00100000:0.0:1787574350.640211:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290119680 00000100:00100000:0.0:1787574350.640248:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787574350.640255:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7646:x1874407290119680:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787574350.640326:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7646:x1874407290119680:12345-0@lo:1000:mdt00_003.0 Request processed in 71us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574350.640333:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787574350.640367:0:7646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1787574350.640371:0:7646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982a3a8ab100, transno 4294967315 00000100:00100000:0.0:1787574350.640383:0:7646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7646:1874407290119680:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787574350.642218:0:7646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1787574350.642314:0:7646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7646:1874407290119808:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787574350.642375:0:7646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574350.642406:0:7646:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0828ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574350.642611:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290119808 00000100:00100000:3.0:1787574350.642618:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290119808 00000100:00100000:3.0:1787574350.643983:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787574350.644010:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7646:x1874407290119808:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787574350.644257:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7646:x1874407290119808:12345-0@lo:1000:mdt00_003.0 Request processed in 263us (1881us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787574350.644269:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787574350.644532:0:7646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7646:1874407290119808:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787574350.644574:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c03fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.644585:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c03fb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.644592:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c03fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.644599:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fb600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574350.644604:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c03fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.644611:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c03fb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.644626:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982a03b34300) 00010000:00010000:0.0:1787574350.644629:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787574350.644633:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c03fb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.644639:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c03fb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.644677:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c0330 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.644684:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c0330 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.644690:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c0330 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.644703:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00e00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574350.644707:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c0330 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.644713:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c0330 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.644722:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a0de1d500) 00010000:00010000:0.0:1787574350.644724:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787574350.644727:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c0330 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.644733:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c0330 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.644753:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0402 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.644765:0:7646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c034c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edb5 expref: 21 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.644774:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0402 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.644803:0:7646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c034c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edb5 expref: 21 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.644817:0:7646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c034c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edb5 expref: 21 pid: 7646 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574350.644842:0:7646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7646:1874407290119936:192.168.206.51@tcp:104: 00000100:00100000:0.0:1787574350.644910:0:7646:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a061e80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574350.649286:0:7646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7646:1874407290119936:192.168.206.51@tcp:104: 00010000:00010000:3.0:1787574350.649313:0:7646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0402 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574350.650542:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574350.650772:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272300672 00000100:00100000:3.0:1787574350.650781:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272300672 00010000:00010000:3.0:1787574350.650819:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c034c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edb5 expref: 22 pid: 7646 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574350.650863:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:3.0:1787574350.650873:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+22:2350:x1874407272300672:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574350.650890:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574350.650898:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c034c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edb5 expref: 22 pid: 7646 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.650911:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c034c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edb5 expref: 22 pid: 7646 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.650933:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c034c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edb5 expref: 22 pid: 7646 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.650950:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a0de1d500) 00010000:00010000:3.0:1787574350.650955:0:8453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0402 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.650965:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0402 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.650979:0:8453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0402 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.651013:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574350.651061:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+21:2350:x1874407272300672:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 189us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574350.651069:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00010000:00010000:3.0:1787574350.651090:0:7646:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0402 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.651097:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0402 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.651108:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0402 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.651114:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0402 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.651121:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0402 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.651126:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574350.651130:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0402 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.651137:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0402 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.651146:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a0de1d500) 00010000:00010000:3.0:1787574350.651149:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574350.651159:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0402 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.651188:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01200/0xfe91058e646c0402 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.651200:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.651206:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.651212:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.651217:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fb400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574350.651221:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.651227:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.651235:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a0de1d500) 00010000:00010000:3.0:1787574350.651238:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787574350.651240:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574350.651245:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c03f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574350.651462:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+20:11513:x1874407272300416:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 26009us (26211us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1787574350.651469:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 186 00000020:00080000:3.0:1787574350.651479:0:7646:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787574350.651601:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787574350.651606:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787574350.652112:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787574350.652119:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787574350.656322:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574350.656715:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272300928 00000100:00100000:2.0:1787574350.656725:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272300928 00000100:00100000:2.0:1787574350.656780:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:2.0:1787574350.656790:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0327e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+20:11513:x1874407272300928:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787574350.657672:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787574350.657875:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1787574350.657925:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c0409 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574350.657940:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c0409 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574350.657951:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c0409 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574350.657960:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c0409 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574350.657966:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c0409 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574350.657972:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c0409 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574350.658004:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574350.658021:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574350.658029:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c0409 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.658036:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0000 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574350.658039:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c0409 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.658047:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c0409 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.658060:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982a04da2600) 00010000:00010000:0.0:1787574350.658063:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787574350.658068:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c0409 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.658073:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c0409 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574350.658087:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574350.658089:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574350.658091:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574350.658106:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0327e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+22:11513:x1874407272300928:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 1315us (1792us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1787574350.658115:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 50 00000020:00080000:1.0:1787574350.658120:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787574350.961464:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290120320:0@lo:400:kworker.0 00000100:00100000:3.0:1787574350.961533:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574350.961579:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574350.961585:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290120448:0@lo:400:kworker.0 00000100:00100000:3.0:1787574350.961609:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574350.961861:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290120192:0@lo:400:kworker.0 00000100:00100000:2.0:1787574350.961893:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290120064:0@lo:400:kworker.0 00000100:00100000:1.0:1787574350.961893:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574350.961913:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290120704:0@lo:400:kworker.0 00000100:00100000:2.0:1787574350.961925:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574350.961943:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574350.961949:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290120576:0@lo:400:kworker.0 00000100:00100000:2.0:1787574350.961969:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574350.962019:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290120064 00000100:00100000:2.0:1787574350.962028:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290120064 00000100:00100000:2.0:1787574350.962089:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787574350.962099:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290120064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574350.962152:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:3298:x1874407290120064:12345-0@lo:400:kworker.0 Request processed in 54us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574350.962159:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787574350.965400:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290120064:0@lo:400:kworker.0 00000100:00100000:1.0:1787574350.967141:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290120320 00000100:00100000:1.0:1787574350.967156:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290120320 00000100:00080000:1.0:1787574350.967200:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574350.967214:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290120448 00000100:00100000:1.0:1787574350.967218:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290120448 00000100:00100000:1.0:1787574350.967263:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290120704 00000100:00100000:1.0:1787574350.967266:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290120704 00000100:00100000:1.0:1787574350.967292:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787574350.967302:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1874407290120448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574350.967395:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1874407290120448:12345-0@lo:400:kworker.0 Request processed in 95us (5784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574350.967402:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787574350.967417:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787574350.967424:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982905b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1874407290120704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574350.967458:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982905b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1874407290120704:12345-0@lo:400:kworker.0 Request processed in 35us (5514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574350.967464:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787574350.967527:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290120448:0@lo:400:kworker.0 00000100:00100000:1.0:1787574350.967559:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290120704:0@lo:400:kworker.0 00000100:00100000:1.0:1787574350.967594:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290120192 00000100:00100000:1.0:1787574350.967598:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290120192 00000100:00100000:1.0:1787574350.967611:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290120576 00000100:00100000:1.0:1787574350.967614:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290120576 00000100:00100000:1.0:1787574350.967633:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787574350.967639:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290120320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574350.967677:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290120320:12345-0@lo:400:kworker.0 Request processed in 38us (6144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574350.967696:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787574350.967708:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787574350.967713:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982905b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290120192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574350.967745:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982905b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290120192:12345-0@lo:400:kworker.0 Request processed in 31us (5851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574350.967750:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787574350.967760:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787574350.967765:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290120576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574350.967792:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290120576:12345-0@lo:400:kworker.0 Request processed in 28us (5823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574350.967798:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:1.0:1787574350.967810:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574350.967827:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290120320:0@lo:400:kworker.0 00000100:00100000:1.0:1787574350.967852:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290120192:0@lo:400:kworker.0 00000100:00100000:1.0:1787574350.967873:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290120576:0@lo:400:kworker.0 00000040:00080000:2.0:1787574351.009624:0:12461:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787574351.009633:0:12461:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787574351.009677:0:12461:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1787574351.009684:0:12461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787574351.167304:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574351.167644:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272301184 00000100:00100000:3.0:1787574351.167653:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272301184 00000100:00100000:3.0:1787574351.167726:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 187 00000100:00100000:3.0:1787574351.167748:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+22:11523:x1874407272301184:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1787574351.167772:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574351.167791:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0410 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eded expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787574351.167831:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787574351.168086:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c0417 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.168101:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c0417 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.168114:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c0417 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574351.168126:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787574351.168327:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0410 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eded expref: 25 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.168346:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c0417 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eded expref: 24 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.168356:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:3.0:1787574351.168359:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787574351.168363:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16143000, rc 0) 00000100:00100000:3.0:1787574351.168436:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+24:11523:x1874407272301184:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 702us (1143us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787574351.168444:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 187 00000100:00100000:2.0:1787574351.173628:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574351.173855:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272301312 00000100:00100000:0.0:1787574351.173875:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272301312 00000100:00100000:0.0:1787574351.173938:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 188 00000100:00100000:0.0:1787574351.173949:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+24:11523:x1874407272301312:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:0.0:1787574351.174028:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c0425 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174044:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c0425 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174056:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c0425 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174085:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c042c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174092:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c042c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174099:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c042c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174556:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c0433 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174565:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c0433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174572:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c0433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574351.174610:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c0433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174633:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c0425 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174640:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c0425 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174647:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c0425 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174652:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574351.174656:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c0425 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174663:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c0425 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174676:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:0.0:1787574351.174678:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574351.174683:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c0425 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174688:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c0425 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174698:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c042c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174705:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c042c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174710:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c042c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174722:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574351.174725:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c042c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174731:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c042c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174739:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982a0de1da00) 00010000:00010000:0.0:1787574351.174814:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574351.174819:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c042c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174825:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c042c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174839:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c0433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174845:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c0433 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174850:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c0433 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174855:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01a00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574351.174857:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c0433 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174863:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c0433 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174881:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a0de1de00) 00010000:00010000:0.0:1787574351.174883:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574351.174886:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c0433 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.174892:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c0433 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574351.174971:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+24:11523:x1874407272301312:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 1022us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574351.174980:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 188 00000100:00100000:3.0:1787574351.250693:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574351.251294:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272301568 00000100:00100000:1.0:1787574351.251303:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272301568 00000100:00100000:1.0:1787574351.251363:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 189 00000100:00100000:1.0:1787574351.251374:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+24:11526:x1874407272301568:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1787574351.251394:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574351.251414:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646c043a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1edf4 expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.251496:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c0441 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.251520:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c0441 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.251532:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c0441 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.251547:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c0448 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.251555:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c0448 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.251562:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c0448 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.251881:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646c044f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.251891:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646c044f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.251899:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646c044f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574351.251909:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787574351.252019:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c0441 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.252027:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c0441 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.252035:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c0441 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.252047:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574351.252051:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c0441 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.252059:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c0441 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.252072:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:1.0:1787574351.252075:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574351.252079:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c0441 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.252086:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c0441 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.252099:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c0448 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.252106:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c0448 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.252113:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c0448 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.252118:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574351.252121:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c0448 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.252127:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c0448 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.252146:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982a04da2700) 00010000:00010000:1.0:1787574351.252148:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574351.252151:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c0448 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.252157:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c0448 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.252224:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646c043a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edf4 expref: 27 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.252238:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646c044f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edf4 expref: 26 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.252245:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2900) 00010000:00010000:1.0:1787574351.252248:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787574351.252250:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0a00, rc 0) 00000100:00100000:1.0:1787574351.252317:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+26:11526:x1874407272301568:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 945us (1635us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1787574351.252325:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 189 00000100:00100000:2.0:1787574351.285144:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574351.285718:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272301696 00000100:00100000:0.0:1787574351.285730:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272301696 00000100:00100000:0.0:1787574351.285794:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 190 00000100:00100000:0.0:1787574351.285805:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+26:11526:x1874407272301696:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:0.0:1787574351.285878:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c045d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.285895:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c045d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.285906:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c045d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.285934:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c045d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.285940:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c045d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.285966:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c045d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.285972:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01a00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574351.285977:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c045d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.285984:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c045d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.286007:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2900) 00010000:00010000:0.0:1787574351.286010:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787574351.286014:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c045d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.286020:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c045d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574351.286101:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+26:11526:x1874407272301696:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 297us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574351.286109:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 190 00000100:00100000:3.0:1787574351.297486:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574351.297610:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272301952 00000100:00100000:0.0:1787574351.297618:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272301952 00000100:00100000:0.0:1787574351.297687:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:0.0:1787574351.297698:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+26:11526:x1874407272301952:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1787574351.297933:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+27:11526:x1874407272301952:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 235us (454us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787574351.297941:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:3.0:1787574351.333243:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574351.333447:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272302208 00000100:00100000:1.0:1787574351.333457:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272302208 00000100:00100000:1.0:1787574351.333520:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 191 00000100:00100000:1.0:1787574351.333540:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+27:11060:x1874407272302208:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1787574351.333563:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574351.333583:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646c0464 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1edfb expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.333705:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c046b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.333720:0:7646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646c044f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edf4 expref: 28 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.333728:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c046b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.333760:0:7646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646c044f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edf4 expref: 28 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.333773:0:7646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646c044f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edf4 expref: 28 pid: 7646 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574351.333786:0:7646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982905b5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7646:1874407290120832:192.168.206.51@tcp:104: 00000100:00100000:1.0:1787574351.333885:0:7646:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a069f89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574351.339429:0:7646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982905b5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7646:1874407290120832:192.168.206.51@tcp:104: 00010000:00010000:1.0:1787574351.339476:0:7646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c046b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574351.339680:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574351.339775:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272302336 00000100:00100000:0.0:1787574351.339783:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272302336 00010000:00010000:0.0:1787574351.339822:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646c044f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edf4 expref: 29 pid: 7646 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574351.339858:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:0.0:1787574351.339869:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+29:2350:x1874407272302336:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574351.339884:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574351.339891:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646c044f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edf4 expref: 29 pid: 7646 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.339903:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646c044f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edf4 expref: 29 pid: 7646 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.339925:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646c044f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edf4 expref: 29 pid: 7646 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.339943:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2900) 00010000:00010000:0.0:1787574351.339947:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c046b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.339956:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c046b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.339978:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c046b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.340012:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574351.340072:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+28:2350:x1874407272302336:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 204us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574351.340094:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 75 00010000:00010000:1.0:1787574351.340344:0:7646:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c046b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.340353:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c046b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574351.340441:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787574351.340650:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0e00/0xfe91058e646c0464 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edfb expref: 29 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.340668:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c046b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edfb expref: 28 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.340676:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2900) 00010000:00010000:1.0:1787574351.340679:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787574351.340681:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0000, rc 0) 00000100:00100000:1.0:1787574351.340727:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+28:11060:x1874407272302208:12345-192.168.206.51@tcp:101:bash.0 Request processed in 7189us (7499us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787574351.340735:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 191 00000100:00100000:2.0:1787574351.346199:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574351.346284:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272302592 00000100:00100000:0.0:1787574351.346300:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272302592 00000100:00100000:0.0:1787574351.346388:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 192 00000100:00100000:0.0:1787574351.346401:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+28:11060:x1874407272302592:12345-192.168.206.51@tcp:36:bash.0 00010000:00010000:0.0:1787574351.346680:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c0479 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.346698:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c0479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.346709:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c0479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787574351.346758:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1787574351.346780:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a627876 reply state 0000000056a72af4 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c0479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574351.346789:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787574351.346835:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1787574351.346939:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+32:11060:x1874407272302592:12345-192.168.206.51@tcp:36:bash.0 Request processed in 540us (781us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1787574351.346947:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 192 00000020:00080000:0.0:1787574351.346952:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1787574351.350230:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c0479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.350253:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c0479 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.350262:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c0479 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.350269:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01a00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574351.350275:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c0479 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.350284:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c0479 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.350307:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2900) 00010000:00010000:1.0:1787574351.350311:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574351.350345:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c0479 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.350353:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c0479 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574351.360463:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574351.360857:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272302720 00000100:00100000:3.0:1787574351.360872:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272302720 00000100:00100000:3.0:1787574351.360969:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 193 00000100:00100000:3.0:1787574351.360983:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+31:11060:x1874407272302720:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1787574351.361028:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574351.361059:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0480 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee02 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.361155:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0480 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee02 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.361219:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0480 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee02 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.361269:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2900) 00010000:00010000:3.0:1787574351.361274:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574351.361279:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142200, rc 0) 00000100:00100000:3.0:1787574351.361360:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+32:11060:x1874407272302720:12345-192.168.206.51@tcp:101:bash.0 Request processed in 380us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574351.361368:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 193 00000100:00100000:2.0:1787574351.368651:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574351.368825:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272302848 00000100:00100000:1.0:1787574351.368838:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272302848 00000100:00100000:1.0:1787574351.368918:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:1.0:1787574351.368930:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:11060:x1874407272302848:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1787574351.368954:0:8472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574351.368983:0:8472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004af6f85e/0xfe91058e646c0487 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee09 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787574351.369026:0:8472:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8c384d, atime: 0x6a8c384b, ctime: 0x6a8c384d, blocks: 0xb 00010000:00010000:1.0:1787574351.369055:0:8472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=327s v=(0 0) 00010000:00010000:1.0:1787574351.369060:0:8472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574351.369070:0:8472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004af6f85e/0xfe91058e646c0487 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee09 expref: 8 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.369104:0:8472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004af6f85e/0xfe91058e646c0487 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee09 expref: 8 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.369120:0:8472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0e00, rc 0) 00000100:00100000:1.0:1787574351.369229:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:11060:x1874407272302848:12345-192.168.206.51@tcp:101:bash.0 Request processed in 301us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574351.369237:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:2.0:1787574351.383574:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574351.383691:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272302976 00000100:00100000:3.0:1787574351.383704:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272302976 00002000:00010000:3.0:1787574351.383773:0:6688:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1787574351.383780:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a41d54000 with x1874407272302976 ext(0->18446744073709551615) 00002000:00010000:3.0:1787574351.383806:0:6688:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff982a41d54000. 00000100:00100000:3.0:1787574351.383848:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:3.0:1787574351.383861:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2351:x1874407272302976:12345-192.168.206.51@tcp:10:bash.0 00002000:00010000:3.0:1787574351.384261:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787574351.384266:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787574349 -> 1787574351 00002000:00010000:3.0:1787574351.384268:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787574347 -> 1787574347 00002000:00010000:3.0:1787574351.384271:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787574349 -> 1787574351 00002000:00010000:3.0:1787574351.384273:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787574351.384361:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:2351:x1874407272302976:12345-192.168.206.51@tcp:10:bash.0 Request processed in 501us (801us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1787574351.384370:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00002000:00010000:3.0:1787574351.384374:0:6688:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1787574351.384377:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a41d54000 with x1874407272302976 ext(0->18446744073709551615) 00002000:00010000:3.0:1787574351.384382:0:6688:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff982a41d54000. 00000100:00100000:3.0:1787574351.473444:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574351.473480:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982905b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290120960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574351.473585:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574351.473929:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290120960 00000100:00100000:1.0:1787574351.473955:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290120960 00000100:00100000:1.0:1787574351.474035:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787574351.474047:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874407290120960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574351.474892:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787574351.475016:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874407290120960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 969us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574351.475026:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787574351.475252:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982905b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290120960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574351.535507:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574351.535623:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272303104 00000100:00100000:0.0:1787574351.535637:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272303104 00000100:00100000:0.0:1787574351.535771:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 194 00000100:00100000:0.0:1787574351.535786:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+32:11540:x1874407272303104:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:0.0:1787574351.535885:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c048e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.535931:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c048e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.535945:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c048e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.535966:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c0495 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.535974:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c0495 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.535980:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c0495 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536367:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c049c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536377:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c049c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536384:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c049c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574351.536436:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c049c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536450:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c048e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536456:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c048e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536474:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c048e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536480:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574351.536485:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c048e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536494:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c048e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536508:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:0.0:1787574351.536512:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574351.536518:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c048e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536524:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c048e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536538:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c0495 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536544:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c0495 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536550:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c0495 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536556:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574351.536559:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c0495 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536575:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c0495 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536583:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982a0de1de00) 00010000:00010000:0.0:1787574351.536585:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574351.536588:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c0495 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536594:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c0495 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536612:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c049c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536618:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c049c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536624:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c049c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536628:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574351.536631:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c049c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536637:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c049c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536644:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2900) 00010000:00010000:0.0:1787574351.536646:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574351.536649:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c049c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.536664:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c049c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574351.536770:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+32:11540:x1874407272303104:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 986us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574351.536779:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 194 00010000:00010000:0.0:1787574351.602510:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574351.608696:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574351.608851:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272303360 00000100:00100000:3.0:1787574351.608864:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272303360 00000100:00100000:3.0:1787574351.608940:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 195 00000100:00100000:3.0:1787574351.608952:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+32:11543:x1874407272303360:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1787574351.608981:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574351.609020:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c04a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee10 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.609121:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c04aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.609139:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c04aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.609190:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c04aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.609211:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c04b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.609219:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c04b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.609225:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c04b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.609618:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c04b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.609631:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c04b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.609639:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c04b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574351.609650:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787574351.610058:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c04aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.610068:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c04aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.610076:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c04aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.610081:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574351.610086:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c04aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.610095:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c04aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.610111:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:3.0:1787574351.610114:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574351.610120:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c04aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.610139:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c04aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.610566:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c04b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.610574:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c04b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.610579:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c04b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.610584:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574351.610587:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c04b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.610592:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c04b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.610602:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982a04dc0400) 00010000:00010000:3.0:1787574351.610605:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574351.610608:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c04b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.610613:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c04b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.610688:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c04a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee10 expref: 35 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.610706:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c04b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee10 expref: 34 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.610796:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2900) 00010000:00010000:3.0:1787574351.610799:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787574351.610802:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142400, rc 0) 00000100:00100000:3.0:1787574351.610893:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+34:11543:x1874407272303360:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1941us (2210us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1787574351.610903:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 195 00000100:00100000:3.0:1787574351.614541:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574351.614695:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272303488 00000100:00100000:2.0:1787574351.614709:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272303488 00000100:00100000:2.0:1787574351.614858:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 196 00000100:00100000:2.0:1787574351.614871:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+34:11543:x1874407272303488:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:2.0:1787574351.614959:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c04c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574351.614980:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c046b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edfb expref: 34 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574351.615015:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c04c6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574351.615060:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c046b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edfb expref: 34 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574351.615090:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c046b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edfb expref: 34 pid: 7646 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574351.615108:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41c19180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874407290121088:192.168.206.51@tcp:104: 00000100:00100000:2.0:1787574351.615262:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a06668d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574351.621629:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574351.623533:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272303744 00000100:00100000:3.0:1787574351.623553:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272303744 00000100:00100000:3.0:1787574351.623642:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:3.0:1787574351.623656:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+35:5588:x1874407272303744:12345-192.168.206.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787574351.624105:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+36:5588:x1874407272303744:12345-192.168.206.51@tcp:35:ldlm_bl.0 Request processed in 450us (2489us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787574351.624114:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:0.0:1787574351.625392:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41c19180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874407290121088:192.168.206.51@tcp:104: 00010000:00010000:0.0:1787574351.625435:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c04c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574351.629878:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574351.630063:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272303872 00000100:00100000:0.0:1787574351.630076:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272303872 00010000:00010000:0.0:1787574351.630138:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c046b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edfb expref: 36 pid: 7646 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574351.630215:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:0.0:1787574351.630227:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a063aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+36:2350:x1874407272303872:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574351.630246:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574351.630254:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c046b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edfb expref: 36 pid: 7646 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.630271:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c046b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edfb expref: 36 pid: 7646 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.630299:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c046b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1edfb expref: 36 pid: 7646 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.630351:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2900) 00010000:00010000:0.0:1787574351.630357:0:8453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c04c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.630366:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c04c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.630374:0:8453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c04c6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.630567:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574351.630672:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a063aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+35:2350:x1874407272303872:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 446us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574351.630681:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00010000:00010000:1.0:1787574351.632494:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c04c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.632512:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c04c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.632560:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c04c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.632568:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c04c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.632576:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c04c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.632583:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fa400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574351.632587:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c04c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.632595:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c04c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.632616:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2900) 00010000:00010000:1.0:1787574351.632620:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787574351.632645:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c04c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.632717:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c04c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574351.633015:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+34:11543:x1874407272303488:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 18141us (18481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574351.633026:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 196 00000100:00100000:2.0:1787574351.642296:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574351.644603:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272304128 00000100:00100000:1.0:1787574351.644623:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272304128 00000100:00100000:1.0:1787574351.644811:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:1.0:1787574351.644825:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+34:11543:x1874407272304128:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1787574351.645194:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+35:11543:x1874407272304128:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 371us (2912us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1787574351.645203:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:2.0:1787574351.761000:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574351.761086:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272304384 00000100:00100000:1.0:1787574351.761100:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272304384 00000100:00100000:1.0:1787574351.761201:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 197 00000100:00100000:1.0:1787574351.761214:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+35:11554:x1874407272304384:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:1.0:1787574351.761245:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574351.761273:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c04cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee17 expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.761369:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c04d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.761454:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c04d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.761488:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c04d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.761508:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c04db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.761517:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c04db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.761524:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c04db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.762105:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646c04e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.762119:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646c04e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.762126:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646c04e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574351.762139:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1787574351.762290:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c04d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.762298:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c04d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.762305:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c04d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.762311:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574351.762324:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c04d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.762333:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c04d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.762348:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:1.0:1787574351.762352:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574351.762357:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c04d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.762363:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c04d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.762376:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c04db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.763895:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c04db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.763926:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c04db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.763933:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574351.763937:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c04db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.763947:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c04db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.763965:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982a04da2400) 00010000:00010000:1.0:1787574351.763969:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574351.763999:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c04db lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.764007:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c04db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.764101:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c04cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee17 expref: 38 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.764118:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646c04e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee17 expref: 37 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.764126:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2900) 00010000:00010000:1.0:1787574351.764128:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787574351.764131:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0800, rc 0) 00000100:00100000:1.0:1787574351.764239:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+37:11554:x1874407272304384:12345-192.168.206.51@tcp:101:cat.0 Request processed in 3025us (3262us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1787574351.764250:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 197 00000100:00100000:2.0:1787574351.774322:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574351.774632:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272304640 00000100:00100000:3.0:1787574351.774645:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272304640 00000100:00100000:1.0:1787574351.774820:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:1.0:1787574351.774838:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+37:11554:x1874407272304640:12345-192.168.206.51@tcp:35:cat.0 00000100:00100000:1.0:1787574351.775157:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+38:11554:x1874407272304640:12345-192.168.206.51@tcp:35:cat.0 Request processed in 323us (851us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787574351.775207:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:2.0:1787574351.809279:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574351.809384:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272304896 00000100:00100000:0.0:1787574351.809398:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272304896 00000100:00100000:0.0:1787574351.809489:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 198 00000100:00100000:0.0:1787574351.809502:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+38:11555:x1874407272304896:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:0.0:1787574351.809580:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787574351.809616:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0800/0xfe91058e646c04e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee17 expref: 38 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.809641:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c04b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee10 expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.809843:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0480 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee02 expref: 36 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.809878:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a04da2900) 00010000:00010000:0.0:1787574351.809892:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574351.809920:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c04f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.809935:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c04f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.809945:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c04f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.809963:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c04f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.809970:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c04f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.809976:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c04f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.810399:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c04fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.810409:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c04fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.810416:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c04fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787574351.813047:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1787574351.813062:0:5830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 327987895889ns, next at 328987892241ns, rc = 0 00010000:00010000:0.0:1787574351.813181:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01800/0xfe91058e646c0505 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.813200:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01800/0xfe91058e646c0505 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.813213:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01800/0xfe91058e646c0505 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.813222:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01800/0xfe91058e646c0505 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.813228:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01800/0xfe91058e646c0505 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.813235:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01800/0xfe91058e646c0505 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.813264:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574351.813292:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c04fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.813298:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c04fe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.813304:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c04fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.813310:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574351.813316:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c04fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.813323:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c04fe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.813344:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a0de1da00) 00010000:00010000:0.0:1787574351.813347:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787574351.813354:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c04fe lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.813361:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c04fe lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.813380:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c04f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.813396:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c04f0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.813402:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c04f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.813407:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574351.813410:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c04f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.813416:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c04f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.813423:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:0.0:1787574351.813426:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574351.813429:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c04f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.813435:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c04f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574351.813454:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d021f9b reply state 0000000086755036 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c04f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574351.813464:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574351.813570:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+37:11555:x1874407272304896:12345-192.168.206.51@tcp:36:rm.0 Request processed in 4066us (4301us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787574351.813582:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 198 00010000:00010000:1.0:1787574351.813817:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574351.813826:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01800/0xfe91058e646c0505 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.813832:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01800 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574351.813842:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01800/0xfe91058e646c0505 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.813849:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01800/0xfe91058e646c0505 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.813861:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982a0de1da00) 00010000:00010000:1.0:1787574351.813863:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787574351.813867:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01800/0xfe91058e646c0505 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.813873:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01800/0xfe91058e646c0505 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.813888:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574351.813890:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574351.813891:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574351.815669:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c04f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.815689:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c04f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.815697:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c04f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.815703:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574351.815708:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c04f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.815723:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c04f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.815760:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982a0de1de00) 00010000:00010000:1.0:1787574351.815763:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574351.815767:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c04f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.815773:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01400/0xfe91058e646c04f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574351.882766:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574351.882902:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272305152 00000100:00100000:3.0:1787574351.882916:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272305152 00000100:00100000:3.0:1787574351.882999:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 199 00000100:00100000:3.0:1787574351.883012:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+36:11561:x1874407272305152:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1787574351.883045:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574351.883073:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c050c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee1e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.883330:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0513 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.883348:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0513 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.883363:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0513 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.883379:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c051a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.883398:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c051a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.883405:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c051a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787574351.884226:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787574351.884648:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c0521 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.884661:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c0521 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.884671:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c0521 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.884706:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0513 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.885071:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0513 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.885078:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0513 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.885085:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16143800 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574351.885091:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0513 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.885100:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0513 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.885114:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:3.0:1787574351.885117:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574351.885123:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0513 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.885129:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0513 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787574351.885145:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064fd7c7a reply state 0000000079b6a06b transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c051a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574351.885156:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787574351.885275:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c050c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee1e expref: 39 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.885293:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c0521 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee1e expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574351.885311:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a04dc0900) 00010000:00010000:3.0:1787574351.885313:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574351.885316:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142000, rc 0) 00000100:00100000:3.0:1787574351.885418:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+39:11561:x1874407272305152:12345-192.168.206.51@tcp:101:bash.0 Request processed in 2408us (2667us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1787574351.885429:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 199 00010000:00010000:1.0:1787574351.888319:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c051a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.888340:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c051a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.888349:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c051a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.888355:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574351.888360:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c051a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.888367:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c051a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.888399:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982a04dc0400) 00010000:00010000:1.0:1787574351.888402:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574351.888407:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c051a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.888413:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c051a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574351.891058:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574351.891286:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272305280 00000100:00100000:1.0:1787574351.891302:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272305280 00000100:00100000:1.0:1787574351.891391:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:1.0:1787574351.891404:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2350:x1874407272305280:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1787574351.891433:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574351.891476:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000358046c1/0xfe91058e646c052f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee25 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787574351.891517:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787574351.891540:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=328s v=(0 0) 00010000:00010000:1.0:1787574351.891545:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574351.891557:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000358046c1/0xfe91058e646c052f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee25 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.891588:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000358046c1/0xfe91058e646c052f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee25 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.891608:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0200, rc 0) 00000100:00080000:0.0:1787574351.891899:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787574351.892584:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2350:x1874407272305280:12345-192.168.206.51@tcp:101:bash.0 Request processed in 1173us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574351.892596:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:2.0:1787574351.903086:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574351.903201:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272305408 00000100:00100000:1.0:1787574351.903215:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272305408 00000100:00100000:1.0:1787574351.903290:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:1.0:1787574351.903305:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:11561:x1874407272305408:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1787574351.903346:0:8472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574351.903373:0:8472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000531a6873/0xfe91058e646c0536 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee2c expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.903427:0:8472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000358046c1/0xfe91058e646c052f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee25 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.903437:0:8472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574351.903442:0:8472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574351.903447:0:8472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000531a6873/0xfe91058e646c0536 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee2c expref: 7 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.903494:0:8472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000358046c1/0xfe91058e646c052f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee25 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.903509:0:8472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000358046c1/0xfe91058e646c052f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee25 expref: 7 pid: 6681 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574351.903524:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982905b59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8472:1874407290121216:192.168.206.51@tcp:104: 00000100:00100000:1.0:1787574351.903647:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a069f8600 going to sleep for 11 seconds 00000100:00100000:1.0:1787574351.908438:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982905b59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8472:1874407290121216:192.168.206.51@tcp:104: 00010000:00010000:1.0:1787574351.908498:0:8472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000531a6873/0xfe91058e646c0536 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee2c expref: 7 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574351.908524:0:8472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0c00, rc 0) 00000100:00100000:1.0:1787574351.908618:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:11561:x1874407272305408:12345-192.168.206.51@tcp:101:bash.0 Request processed in 5315us (5545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574351.908628:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:2.0:1787574351.913065:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574351.916431:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272305536 00000100:00100000:0.0:1787574351.916454:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272305536 00010000:00010000:0.0:1787574351.916535:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000358046c1/0xfe91058e646c052f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee25 expref: 7 pid: 6681 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574351.916592:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:0.0:1787574351.916604:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2352:x1874407272305536:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574351.916627:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574351.916670:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000358046c1/0xfe91058e646c052f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee25 expref: 7 pid: 6681 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.916688:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000358046c1/0xfe91058e646c052f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee25 expref: 7 pid: 6681 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.916874:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000358046c1/0xfe91058e646c052f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee25 expref: 7 pid: 6681 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.916895:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574351.916920:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574351.916931:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000531a6873/0xfe91058e646c0536 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee2c expref: 6 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.916943:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000531a6873/0xfe91058e646c0536 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee2c expref: 6 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574351.917003:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000531a6873/0xfe91058e646c0536 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee2c expref: 6 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574351.917020:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5817:1874407290121344:192.168.206.51@tcp:105: 00000100:00100000:0.0:1787574351.917212:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a2e0fdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787574351.932214:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574351.932302:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272305792 00000100:00100000:1.0:1787574351.932314:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272305792 00000100:00100000:1.0:1787574351.932394:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:1.0:1787574351.932407:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+38:11561:x1874407272305792:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:1.0:1787574351.932878:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+39:11561:x1874407272305792:12345-192.168.206.51@tcp:35:bash.0 Request processed in 473us (725us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1787574351.932887:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:0.0:1787574351.933224:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5817:1874407290121344:192.168.206.51@tcp:105: 00010000:00010000:0.0:1787574351.933252:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574351.933297:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2352:x1874407272305536:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 16695us (20246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574351.933307:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:2.0:1787574352.164591:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574352.164939:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574352.165042:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272306048 00000100:00100000:1.0:1787574352.165054:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272306048 00000100:00100000:1.0:1787574352.165152:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:1.0:1787574352.165202:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:2350:x1874407272306048:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574352.165303:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:2350:x1874407272306048:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 140us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574352.165311:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00080000:2.0:1787574352.165865:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574352.166594:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272305920 00000100:00100000:0.0:1787574352.166605:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272305920 00000100:00100000:0.0:1787574352.166664:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 295 00000100:00100000:0.0:1787574352.166685:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+13:2350:x1874407272305920:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574352.166769:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+13:2350:x1874407272305920:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 95us (2190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574352.166776:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 295 00000100:00100000:2.0:1787574352.174344:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574352.174701:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272306176 00000100:00100000:1.0:1787574352.174712:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272306176 00000100:00100000:1.0:1787574352.174792:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 152 00000100:00100000:1.0:1787574352.174803:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2351:x1874407272306176:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574352.174898:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2351:x1874407272306176:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 97us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574352.174906:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 152 00000100:00080000:2.0:1787574352.175042:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574352.197312:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574352.197415:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272306304 00000100:00100000:1.0:1787574352.197426:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272306304 00000100:00100000:1.0:1787574352.197511:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 200 00000100:00100000:1.0:1787574352.197521:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+39:11577:x1874407272306304:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1787574352.197547:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574352.197568:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c053d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee33 expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.197644:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0544 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.197668:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.197680:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574352.197740:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787574352.197744:0:7646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787574352.197765:0:7646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.197790:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c053d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee33 expref: 41 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.197811:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0544 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee33 expref: 40 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.197820:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:1.0:1787574352.197823:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787574352.197827:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1000, rc 0) 00000100:00100000:1.0:1787574352.197893:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+40:11577:x1874407272306304:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 372us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574352.197907:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 200 00000100:00100000:3.0:1787574352.203011:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574352.203561:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272306560 00000100:00100000:0.0:1787574352.203573:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272306560 00000100:00100000:0.0:1787574352.203718:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 201 00000100:00100000:0.0:1787574352.203730:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+40:11577:x1874407272306560:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1787574352.203751:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574352.203772:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c054b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee3a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.203877:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c0552 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.203892:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c0552 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.203904:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c0552 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574352.203914:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787574352.204046:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c054b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee3a expref: 43 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.204064:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c0552 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee3a expref: 42 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.204072:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a04dc0900) 00010000:00010000:0.0:1787574352.204075:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574352.204079:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a41d00c00, rc 0) 00000100:00100000:0.0:1787574352.204148:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+42:11577:x1874407272306560:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 421us (1147us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1787574352.204155:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 201 00000100:00100000:2.0:1787574352.209376:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574352.209414:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272306688 00000100:00100000:2.0:1787574352.209425:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272306688 00000100:00100000:2.0:1787574352.209498:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:2.0:1787574352.209509:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+42:2353:x1874407272306688:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574352.209524:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574352.209554:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c0552 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee3a expref: 42 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.209574:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a04dc0900) 00010000:00010000:2.0:1787574352.209579:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574352.209633:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+41:2353:x1874407272306688:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 125us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574352.209641:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:2.0:1787574352.214429:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574352.214626:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272306944 00000100:00100000:1.0:1787574352.214639:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272306944 00000100:00100000:1.0:1787574352.214761:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 202 00000100:00100000:1.0:1787574352.214773:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+41:11577:x1874407272306944:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1787574352.214797:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574352.214831:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0560 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee41 expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.214924:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0567 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.214938:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0567 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.214958:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0567 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574352.214970:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787574352.215104:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0560 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee41 expref: 44 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.215124:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0567 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee41 expref: 43 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.215133:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a04dc0900) 00010000:00010000:1.0:1787574352.215136:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787574352.215139:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1e00, rc 0) 00000100:00100000:1.0:1787574352.215268:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+43:11577:x1874407272306944:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 497us (852us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1787574352.215275:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 202 00000100:00100000:2.0:1787574352.222536:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574352.222845:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272307072 00000100:00100000:3.0:1787574352.222855:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272307072 00000100:00100000:3.0:1787574352.222916:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:3.0:1787574352.222928:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+6:2351:x1874407272307072:12345-192.168.206.51@tcp:1:lfs.0 00010000:00010000:3.0:1787574352.222980:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0575 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.223015:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000531a6873/0xfe91058e646c0536 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee2c expref: 6 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.223024:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574352.223029:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787574352.223033:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0575 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.223070:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000531a6873/0xfe91058e646c0536 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee2c expref: 6 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.223103:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000531a6873/0xfe91058e646c0536 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee2c expref: 6 pid: 8472 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574352.223118:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6682:1874407290121472:192.168.206.51@tcp:104: 00000100:00100000:3.0:1787574352.223260:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04f70c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787574352.230200:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574352.230351:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272307200 00000100:00100000:0.0:1787574352.230377:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272307200 00002000:00100000:0.0:1787574352.230430:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff982a2e0e3b80 x1874407272307200/t0(0) o4->a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp:123/0 lens 504/0 e 0 to 0 dl 1787574363 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787574352.230442:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a2e0e3b80 with x1874407272307200 ext(0->8) 00010000:00010000:0.0:1787574352.230533:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000531a6873/0xfe91058e646c0536 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee2c expref: 7 pid: 8472 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.230551:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000531a6873/0xfe91058e646c0536 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee2c expref: 7 pid: 8472 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787574352.230559:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff982a2e0e3b80 00000100:00100000:0.0:1787574352.230600:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:0.0:1787574352.230610:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2351:x1874407272307200:12345-192.168.206.51@tcp:4:lfs.0 00000100:00100000:3.0:1787574352.231229:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6682:1874407290121472:192.168.206.51@tcp:104: 00010000:00010000:3.0:1787574352.231252:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0575 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574352.231654:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:2351:x1874407272307200:12345-192.168.206.51@tcp:4:lfs.0 Request processed in 1042us (1460us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787574352.231663:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00002000:00100000:0.0:1787574352.231674:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff982a2e0e3b80 x1874407272307200/t4294967308(0) o4->a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp:123/0 lens 504/448 e 0 to 0 dl 1787574363 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787574352.231683:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a2e0e3b80 with x1874407272307200 ext(0->8) 00010000:00010000:0.0:1787574352.231701:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000531a6873/0xfe91058e646c0536 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee2c expref: 9 pid: 8472 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.231715:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000531a6873/0xfe91058e646c0536 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee2c expref: 9 pid: 8472 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787574352.231736:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff982a2e0e3b80 00000100:00100000:2.0:1787574352.237776:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574352.241405:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272307328 00000100:00100000:3.0:1787574352.241423:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272307328 00010000:00010000:3.0:1787574352.241554:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000531a6873/0xfe91058e646c0536 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee2c expref: 9 pid: 8472 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574352.241596:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:3.0:1787574352.241606:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:2351:x1874407272307328:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574352.241621:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787574352.241641:0:5816:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787574352.241644:0:5816:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787574351 00002000:00010000:3.0:1787574352.242096:0:5816:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787574352 00002000:00010000:3.0:1787574352.242100:0:5816:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787574351 00010000:00010000:3.0:1787574352.242109:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000531a6873/0xfe91058e646c0536 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee2c expref: 9 pid: 8472 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.242144:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000531a6873/0xfe91058e646c0536 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee2c expref: 9 pid: 8472 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.242204:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000531a6873/0xfe91058e646c0536 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee2c expref: 9 pid: 8472 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.242221:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787574352.242225:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787574352.242231:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0575 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.242250:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0575 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.242281:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574352.242347:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2351:x1874407272307328:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 742us (4580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574352.242355:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00010000:00010000:1.0:1787574352.243263:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0575 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.243278:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0575 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.243315:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0575 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.243323:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0575 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.243330:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0575 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.243337:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16143a00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574352.243342:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0575 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.243351:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0575 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.243368:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0575 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.243394:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052a40fb0/0xfe91058e646c0575 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574352.243683:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2351:x1874407272307072:12345-192.168.206.51@tcp:1:lfs.0 Request processed in 20753us (21153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574352.243904:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:2.0:1787574352.262343:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574352.262562:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272307584 00000100:00100000:1.0:1787574352.262573:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272307584 00000100:00100000:1.0:1787574352.262633:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:1.0:1787574352.262645:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0327f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+43:11577:x1874407272307584:12345-192.168.206.51@tcp:35:lfs.0 00000004:00010000:1.0:1787574352.262727:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0567 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee41 expref: 43 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787574352.263209:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1787574352.263268:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1787574352.264089:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1787574352.264151:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c057c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.264200:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c0521 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee1e expref: 47 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.264209:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c057c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.264551:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c0521 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee1e expref: 47 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.264569:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c0521 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee1e expref: 47 pid: 5831 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574352.264583:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982905b59500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1874407290121600:192.168.206.51@tcp:104: 00000100:00100000:2.0:1787574352.267109:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a069f8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574352.274532:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982905b59500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1874407290121600:192.168.206.51@tcp:104: 00010000:00010000:0.0:1787574352.274568:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c057c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574352.274856:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574352.274941:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272307712 00000100:00100000:0.0:1787574352.274948:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272307712 00010000:00010000:0.0:1787574352.274994:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c0521 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee1e expref: 48 pid: 5831 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574352.275036:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:0.0:1787574352.275046:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+48:2350:x1874407272307712:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574352.275060:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574352.275067:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c0521 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee1e expref: 48 pid: 5831 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.275078:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c0521 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee1e expref: 48 pid: 5831 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.275099:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c0521 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee1e expref: 48 pid: 5831 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.275116:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a04dc0900) 00010000:00010000:0.0:1787574352.275121:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c057c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.275144:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c057c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.275152:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c057c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.275224:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574352.275280:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+47:2350:x1874407272307712:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 235us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574352.275288:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 79 00010000:00010000:1.0:1787574352.275621:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c057c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.275642:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c057c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787574352.275793:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1787574352.276998:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1787574352.277138:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1874407290121728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787574352.277274:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574352.277313:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a02916e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787574352.277437:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290121728 00000100:00100000:2.0:1787574352.277454:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290121728 00000100:00100000:2.0:1787574352.277518:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787574352.277529:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1874407290121728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787574352.277611:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1874407290121728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 84us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574352.277618:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787574352.277813:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787574352.278006:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1874407290121728:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787574352.279333:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1787574352.279418:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982905b58700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1874407290121856:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787574352.280666:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574352.281064:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a069f8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787574352.281380:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290121856 00000100:00100000:2.0:1787574352.281389:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290121856 00000100:00100000:2.0:1787574352.281564:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574352.281576:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982905b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1874407290121856:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787574352.281837:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982905b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5833:x1874407290121856:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 262us (1175us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787574352.281845:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787574352.282688:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982905b58700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1874407290121856:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787574352.282778:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1787574352.285377:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c057c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.285395:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c057c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.285403:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c057c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.285409:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574352.285413:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c057c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.285420:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c057c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.285441:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a04dc0900) 00010000:00010000:1.0:1787574352.285610:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787574352.285616:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c057c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.285623:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c057c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787574352.285876:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787574352.286014:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1787574352.286026:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 328460859466ns, next at 329460856814ns, rc = 0 00000001:00080000:1.0:1787574352.286034:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1787574352.286082:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a04dc0900) 00010000:00010000:1.0:1787574352.286085:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787574352.286094:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0567 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee41 expref: 51 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574352.286245:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0327f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+50:11577:x1874407272307584:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 23602us (23911us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1787574352.286254:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 56 00000020:00080000:1.0:1787574352.286259:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787574352.289439:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574352.289604:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272307840 00000100:00100000:0.0:1787574352.289615:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272307840 00000100:00100000:0.0:1787574352.290099:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 203 00000100:00100000:0.0:1787574352.290112:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982905b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+50:11577:x1874407272307840:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1787574352.290140:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574352.290199:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00200/0xfe91058e646c0583 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee48 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.290386:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00200/0xfe91058e646c0583 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee48 expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.290402:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00200/0xfe91058e646c0583 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee48 expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.290438:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:0.0:1787574352.290442:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787574352.290460:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a41d00200, rc 0) 00000100:00100000:0.0:1787574352.290524:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982905b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+51:11577:x1874407272307840:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 415us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574352.290531:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 203 00000100:00100000:3.0:1787574352.297576:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574352.297789:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272308096 00000100:00100000:1.0:1787574352.297800:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272308096 00000100:00100000:1.0:1787574352.297874:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:1.0:1787574352.297886:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+51:11577:x1874407272308096:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1787574352.298127:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+52:11577:x1874407272308096:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 242us (558us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1787574352.298135:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:3.0:1787574352.435838:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574352.435960:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272308224 00000100:00100000:1.0:1787574352.435971:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272308224 00000100:00100000:1.0:1787574352.436049:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 204 00000100:00100000:1.0:1787574352.436061:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+52:11587:x1874407272308224:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:1.0:1787574352.436134:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c058a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436150:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c058a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436161:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c058a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436205:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0591 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436212:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0591 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436220:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0591 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436323:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c0598 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436332:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c0598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436339:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c0598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787574352.436378:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c0598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436405:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c058a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436412:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c058a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436419:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c058a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436425:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1e00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574352.436429:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c058a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436436:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c058a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436448:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:1.0:1787574352.436451:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574352.436455:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c058a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436461:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c058a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436474:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0591 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436480:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0591 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436485:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0591 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436496:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574352.436498:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0591 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436504:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0591 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436511:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982a04da2400) 00010000:00010000:1.0:1787574352.436513:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574352.436516:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0591 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436522:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0591 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436536:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c0598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436542:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c0598 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436548:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c0598 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436553:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574352.436556:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c0598 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436561:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c0598 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436578:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:1.0:1787574352.436580:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574352.436583:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c0598 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.436589:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c0598 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574352.436673:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+52:11587:x1874407272308224:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 613us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574352.436681:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 204 00000100:00100000:3.0:1787574352.504435:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290121984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574352.504513:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574352.504682:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290121984 00000100:00100000:0.0:1787574352.504691:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290121984 00000100:00100000:0.0:1787574352.504773:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787574352.504784:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874407290121984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574352.504835:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787574352.504997:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574352.505213:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874407290121984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 430us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574352.505221:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787574352.505375:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290121984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574352.509133:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574352.509387:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272308480 00000100:00100000:2.0:1787574352.509399:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272308480 00000100:00100000:2.0:1787574352.509468:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 205 00000100:00100000:2.0:1787574352.509480:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982905b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+52:11590:x1874407272308480:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1787574352.509501:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574352.509523:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c059f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee4f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.509612:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c05a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.509644:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c05a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.509661:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c05a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.509676:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c05ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.509683:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c05ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.509690:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c05ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.509838:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c05b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.509940:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c05b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.509949:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c05b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574352.509960:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787574352.510071:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c05a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.510079:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c05a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.510086:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c05a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.510097:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fb400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574352.510102:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c05a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.510109:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c05a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.510122:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:2.0:1787574352.510125:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574352.510129:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c05a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.510135:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c05a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.510148:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c05ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.510915:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c05ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.510923:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c05ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.510929:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fb200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574352.510932:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c05ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.510939:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c05ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.510963:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982a03b34400) 00010000:00010000:2.0:1787574352.510966:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574352.510969:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c05ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.510975:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c05ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.511037:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c059f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee4f expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.511050:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c05b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee4f expref: 54 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.511057:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:2.0:1787574352.511060:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574352.511063:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fb600, rc 0) 00000100:00100000:2.0:1787574352.511138:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982905b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+54:11590:x1874407272308480:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1660us (2014us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787574352.511145:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 205 00000100:00100000:1.0:1787574352.525717:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574352.525927:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272308608 00000100:00100000:3.0:1787574352.525939:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272308608 00000100:00100000:3.0:1787574352.526034:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 206 00000100:00100000:3.0:1787574352.526060:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982905b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+54:11590:x1874407272308608:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:3.0:1787574352.526132:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c05c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.526147:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c05c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.526158:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c05c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.526200:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c05c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.526208:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c05c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.526215:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c05c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.526221:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16143800 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574352.526225:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c05c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.526233:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c05c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.526401:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:3.0:1787574352.526404:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787574352.526408:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c05c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.526415:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c05c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574352.526550:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982905b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+54:11590:x1874407272308608:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 492us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574352.526558:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 206 00000100:00100000:3.0:1787574352.528874:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574352.528967:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272308864 00000100:00100000:1.0:1787574352.528976:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272308864 00000100:00100000:1.0:1787574352.529043:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:1.0:1787574352.529053:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+54:11590:x1874407272308864:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1787574352.529364:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+55:11590:x1874407272308864:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 311us (500us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1787574352.529372:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:2.0:1787574352.615226:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574352.615392:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272309120 00000100:00100000:0.0:1787574352.615402:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272309120 00000100:00100000:0.0:1787574352.615458:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 207 00000100:00100000:0.0:1787574352.615477:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+55:11600:x1874407272309120:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1787574352.615503:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574352.615506:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787574352.615537:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0544 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee33 expref: 55 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.615559:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:0.0:1787574352.615565:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574352.615593:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c05c9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee56 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.615702:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c05d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.615715:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c05b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee4f expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.615723:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c05d0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.615756:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c05b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee4f expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.615769:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c05b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee4f expref: 55 pid: 5830 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574352.615783:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874407290122112:192.168.206.51@tcp:104: 00000100:00100000:0.0:1787574352.615877:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0828ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574352.620852:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874407290122112:192.168.206.51@tcp:104: 00010000:00010000:1.0:1787574352.620883:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c05d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574352.621283:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574352.621550:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272309248 00000100:00100000:3.0:1787574352.621558:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272309248 00010000:00010000:3.0:1787574352.621591:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c05b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee4f expref: 56 pid: 5830 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574352.621626:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:3.0:1787574352.621636:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+56:2351:x1874407272309248:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574352.621660:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574352.621667:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c05b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee4f expref: 56 pid: 5830 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.621679:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c05b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee4f expref: 56 pid: 5830 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.621701:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c05b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee4f expref: 56 pid: 5830 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.621716:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:3.0:1787574352.621721:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c05d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.621730:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c05d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.621747:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c05d0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.621778:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574352.621831:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+55:2351:x1874407272309248:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 197us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574352.621839:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00010000:00010000:1.0:1787574352.621938:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c05d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.621947:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c05d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574352.621966:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787574352.622124:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c05c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee56 expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.622142:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c05d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee56 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.622150:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:1.0:1787574352.622153:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787574352.622155:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a41d00000, rc 0) 00000100:00100000:1.0:1787574352.622230:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+55:11600:x1874407272309120:12345-192.168.206.51@tcp:101:bash.0 Request processed in 6756us (7014us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1787574352.622350:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 207 00000100:00100000:0.0:1787574352.625890:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574352.626156:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272309504 00000100:00100000:1.0:1787574352.626204:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272309504 00000100:00100000:1.0:1787574352.626253:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 208 00000100:00100000:1.0:1787574352.626263:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+55:11600:x1874407272309504:12345-192.168.206.51@tcp:36:bash.0 00010000:00010000:1.0:1787574352.626521:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c05de lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.626538:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c05de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.626562:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c05de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787574352.626616:0:7646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1787574352.626641:0:7646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec7dd8fd reply state 0000000068688138 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c05de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.626759:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574352.627025:0:7646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787574352.627125:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+58:11600:x1874407272309504:12345-192.168.206.51@tcp:36:bash.0 Request processed in 861us (1242us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1787574352.627134:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 208 00000020:00080000:1.0:1787574352.627139:0:7646:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787574352.630913:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574352.631287:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272309632 00000100:00100000:2.0:1787574352.631297:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272309632 00010000:00010000:1.0:1787574352.631423:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c05de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.631449:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c05de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.631465:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c05de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.631472:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574352.631477:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c05de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.631485:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c05de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.631502:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:1.0:1787574352.631504:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574352.631525:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c05de lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.631532:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c05de lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574352.631803:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 209 00000100:00100000:2.0:1787574352.631816:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+57:11600:x1874407272309632:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1787574352.631839:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574352.631862:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c05e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee5d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.631946:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c05ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.631959:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c05d0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee56 expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.631967:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c05ec lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.632012:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c05d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee56 expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.632026:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c05d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee56 expref: 58 pid: 5832 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574352.632040:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a2e0e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874407290122240:192.168.206.51@tcp:104: 00000100:00100000:2.0:1787574352.632133:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a06668840 going to sleep for 11 seconds 00000100:00100000:3.0:1787574352.634878:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a2e0e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1874407290122240:192.168.206.51@tcp:104: 00010000:00010000:3.0:1787574352.634912:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c05ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574352.636504:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574352.637020:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272309760 00000100:00100000:2.0:1787574352.637030:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272309760 00010000:00010000:2.0:1787574352.637072:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c05d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee56 expref: 59 pid: 5832 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574352.637119:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:2.0:1787574352.637130:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982905b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+59:2351:x1874407272309760:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574352.637144:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574352.637151:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c05d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee56 expref: 59 pid: 5832 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.637215:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c05d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee56 expref: 59 pid: 5832 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.637237:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00000/0xfe91058e646c05d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee56 expref: 59 pid: 5832 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.637255:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:2.0:1787574352.637261:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c05ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.637269:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c05ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.637276:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c05ec lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.637303:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574352.637352:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982905b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+58:2351:x1874407272309760:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 224us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574352.637360:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 81 00010000:00010000:1.0:1787574352.637944:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c05ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.637954:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c05ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574352.638009:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787574352.638013:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787574352.638035:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c05ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.638067:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c05e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee5d expref: 58 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.638082:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c05ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee5d expref: 57 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.638090:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:1.0:1787574352.638092:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787574352.638095:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fae00, rc 0) 00000100:00100000:1.0:1787574352.638138:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+57:11600:x1874407272309632:12345-192.168.206.51@tcp:101:bash.0 Request processed in 6325us (7233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574352.638145:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 209 00000100:00100000:1.0:1787574352.641346:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574352.641413:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272310016 00000100:00100000:3.0:1787574352.641423:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272310016 00000100:00100000:3.0:1787574352.641488:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:3.0:1787574352.641498:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982905b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+57:11600:x1874407272310016:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:3.0:1787574352.641805:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982905b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+58:11600:x1874407272310016:12345-192.168.206.51@tcp:35:bash.0 Request processed in 307us (464us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1787574352.641813:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 59 00000040:00080000:3.0:1787574352.689486:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787574352.689496:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787574352.689711:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787574352.689718:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787574352.735555:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574352.735768:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272310144 00000100:00100000:3.0:1787574352.735779:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272310144 00000100:00100000:3.0:1787574352.735850:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 210 00000100:00100000:3.0:1787574352.735869:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+58:11606:x1874407272310144:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1787574352.735913:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574352.735931:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c05f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee64 expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.736005:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c05fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.736018:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c05fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.736029:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c05fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574352.736094:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787574352.736098:0:7646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787574352.736121:0:7646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c05fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.736145:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c05f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee64 expref: 60 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.736214:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c05fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee64 expref: 59 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.736224:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:3.0:1787574352.736227:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574352.736230:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142000, rc 0) 00000100:00100000:3.0:1787574352.736282:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+59:11606:x1874407272310144:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 415us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574352.736289:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 210 00000100:00100000:0.0:1787574352.744074:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574352.744516:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272310272 00000100:00100000:1.0:1787574352.744526:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272310272 00000100:00100000:1.0:1787574352.744637:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 211 00000100:00100000:1.0:1787574352.744658:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+59:11606:x1874407272310272:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1787574352.744678:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574352.744698:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c0601 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee6b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.744770:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0608 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.744783:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0608 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.744794:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0608 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.744813:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c060f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.744820:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c060f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.744828:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c060f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.745004:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0616 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.745014:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.745046:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574352.745084:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787574352.745088:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787574352.745104:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.745116:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.745123:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0608 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.745129:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0608 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.745135:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0608 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.745140:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1e00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574352.745144:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0608 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.745150:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0608 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.745206:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:1.0:1787574352.745208:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574352.745213:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0608 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.745227:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c0608 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.745240:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c060f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.745246:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c060f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.745251:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c060f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.745255:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574352.745257:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c060f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.745262:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c060f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.745269:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982a04da2400) 00010000:00010000:1.0:1787574352.745271:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574352.745274:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c060f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.745279:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c060f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.745308:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c0601 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee6b expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.745321:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0616 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee6b expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.745335:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:1.0:1787574352.745338:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787574352.745341:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1000, rc 0) 00000100:00100000:1.0:1787574352.745467:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+60:11606:x1874407272310272:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 820us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574352.745476:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 211 00000100:00100000:1.0:1787574352.754402:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574352.754452:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574352.754673:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272310656 00000100:00100000:2.0:1787574352.754683:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272310656 00000100:00100000:2.0:1787574352.754746:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 212 00000100:00100000:2.0:1787574352.754756:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982905b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+60:11606:x1874407272310656:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1787574352.754779:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574352.754801:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c061d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee72 expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.754927:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0624 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.754942:0:7646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c05ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee5d expref: 61 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.754950:0:7646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0616 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee6b expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.754958:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0624 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.755004:0:7646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0616 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee6b expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.755016:0:7646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0616 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee6b expref: 61 pid: 5832 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574352.755030:0:7646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a2e0e3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7646:1874407290122368:192.168.206.51@tcp:104: 00010000:00010000:2.0:1787574352.755142:0:7646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c05ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee5d expref: 61 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574352.755150:0:7646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c05ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee5d expref: 61 pid: 5830 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574352.755159:0:7646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a2e0e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7646:1874407290122496:192.168.206.51@tcp:104: 00000100:00100000:2.0:1787574352.755230:0:7646:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a06668480 going to sleep for 11 seconds 00000100:00100000:3.0:1787574352.755429:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272310400 00000100:00100000:3.0:1787574352.755490:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272310400 00010000:00010000:3.0:1787574352.755517:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0616 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee6b expref: 62 pid: 5832 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574352.755555:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:3.0:1787574352.755564:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a063a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+62:2352:x1874407272310400:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574352.755572:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574352.755578:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0616 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee6b expref: 62 pid: 5832 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.755591:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0616 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee6b expref: 62 pid: 5832 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.755609:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:3.0:1787574352.755614:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0624 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.755621:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0624 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.755627:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574352.755666:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a063a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+62:2352:x1874407272310400:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 103us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574352.755673:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 82 00010000:00010000:3.0:1787574352.761308:0:7646:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.51@tcp) returned -22 from blocking AST (req@0000000048522c14 x1874407290122368) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0616 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee6b expref: 61 pid: 5832 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.761355:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0616 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee6b expref: 61 pid: 5832 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574352.761375:0:7646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a2e0e3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7646:1874407290122368:192.168.206.51@tcp:104: 00000100:00100000:3.0:1787574352.761393:0:7646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a2e0e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7646:1874407290122496:192.168.206.51@tcp:104: 00010000:00010000:3.0:1787574352.761432:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:3.0:1787574352.761438:0:7646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0624 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.761446:0:7646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0624 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.761462:0:7646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0624 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574352.761673:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574352.761772:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272310784 00000100:00100000:0.0:1787574352.761781:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272310784 00010000:00010000:0.0:1787574352.761817:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c05ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee5d expref: 61 pid: 5830 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574352.761857:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:0.0:1787574352.761877:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982905b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+61:2351:x1874407272310784:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574352.761891:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574352.761897:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c05ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee5d expref: 61 pid: 5830 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.761908:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c05ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee5d expref: 61 pid: 5830 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.761929:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c05ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee5d expref: 61 pid: 5830 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.761940:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:0.0:1787574352.761944:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0624 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.761953:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0624 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.761961:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0624 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574352.762001:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574352.762055:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982905b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+60:2351:x1874407272310784:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 180us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574352.762063:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 83 00010000:00010000:1.0:1787574352.762628:0:7646:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0624 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.762638:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0624 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574352.762672:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787574352.762831:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c061d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee72 expref: 61 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.762849:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0624 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee72 expref: 60 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574352.762858:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:1.0:1787574352.762861:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787574352.762863:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fa600, rc 0) 00000100:00100000:1.0:1787574352.762913:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982905b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+60:11606:x1874407272310656:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 8157us (8459us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787574352.762933:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 212 00000100:00100000:1.0:1787574352.766766:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574352.766838:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272311040 00000100:00100000:3.0:1787574352.766848:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272311040 00000100:00100000:3.0:1787574352.766923:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:3.0:1787574352.766934:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982905b59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+60:11606:x1874407272311040:12345-192.168.206.51@tcp:103:lfs.0 00010000:00010000:3.0:1787574352.766949:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574352.766975:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00200/0xfe91058e646c0583 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee48 expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.767004:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:3.0:1787574352.767010:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574352.767084:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982905b59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+59:11606:x1874407272311040:12345-192.168.206.51@tcp:103:lfs.0 Request processed in 151us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574352.767092:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:0.0:1787574352.774829:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574352.774968:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272311168 00000100:00100000:3.0:1787574352.774978:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272311168 00000100:00100000:3.0:1787574352.775338:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 213 00000100:00100000:3.0:1787574352.775347:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+59:11606:x1874407272311168:12345-192.168.206.51@tcp:58:lfs.0 00010000:00010000:3.0:1787574352.775488:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0632 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.775508:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0632 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.775520:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0632 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787574352.775789:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787574352.776044:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+59:11606:x1874407272311168:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 693us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574352.776055:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 213 00000100:00100000:0.0:1787574352.779558:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574352.779735:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272311296 00000100:00100000:3.0:1787574352.779744:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272311296 00000100:00100000:3.0:1787574352.779843:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 214 00000100:00100000:3.0:1787574352.779853:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+59:11606:x1874407272311296:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1787574352.779875:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574352.779896:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c0639 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee79 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.780925:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0632 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.780942:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c0639 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee79 expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.780992:0:5831:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0632 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.781009:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c0639 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee79 expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.781025:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:3.0:1787574352.781028:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574352.781032:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c0639 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee79 expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574352.781041:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16143a00, rc 0) 00000100:00100000:3.0:1787574352.781422:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+60:11606:x1874407272311296:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1569us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574352.781431:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 214 00000001:00080000:3.0:1787574353.625718:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1787574353.629448:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1787574353.629709:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:1.0:1787574353.649812:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787574353.713545:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787574353.713558:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787574353.713604:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787574353.713612:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787574353.713775:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874407290122624:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787574353.714158:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a26fc6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574353.718562:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574353.718722:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272311424 00000100:00100000:1.0:1787574353.718734:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272311424 00000100:00100000:1.0:1787574353.718835:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 215 00000100:00100000:1.0:1787574353.718848:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3ad34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+61:11607:x1874407272311424:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787574353.718902:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787574353.719052:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3ad34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+61:11607:x1874407272311424:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 205us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574353.719060:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 215 00000100:00080000:0.0:1787574353.719721:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574353.720726:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874407290122624:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787574353.725568:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574353.725692:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272311552 00000100:00100000:3.0:1787574353.725724:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272311552 00000100:00100000:3.0:1787574353.725870:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 216 00000100:00100000:3.0:1787574353.725883:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982905b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+60:11607:x1874407272311552:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787574353.725996:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0640 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726015:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0640 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726028:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0640 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726046:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0647 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726054:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0647 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726060:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0647 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726561:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c064e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726572:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c064e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726580:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c064e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574353.726629:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787574353.726634:0:7646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787574353.726660:0:7646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c064e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726674:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0640 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726680:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0640 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726686:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0640 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726693:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574353.726698:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0640 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726706:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0640 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726720:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982a04da2c00) 00010000:00010000:3.0:1787574353.726723:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574353.726728:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0640 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726735:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0640 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726750:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0647 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726755:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0647 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726760:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0647 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726772:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574353.726775:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0647 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726780:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0647 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726788:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff982a04dc0800) 00010000:00010000:3.0:1787574353.726790:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574353.726793:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0647 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726799:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0647 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726815:0:7646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c064e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726821:0:7646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c064e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726826:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c064e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726831:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574353.726833:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c064e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.726839:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c064e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.727990:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:3.0:1787574353.727993:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574353.727999:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c064e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.728006:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c064e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574353.728452:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982905b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+60:11607:x1874407272311552:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 2565us (2890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574353.728465:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 216 00000100:00100000:2.0:1787574353.738250:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574353.739865:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272311808 00000100:00100000:1.0:1787574353.739883:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272311808 00000100:00100000:1.0:1787574353.739962:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 217 00000100:00100000:1.0:1787574353.739984:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+60:11607:x1874407272311808:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787574353.740012:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574353.740040:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0655 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee80 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.740196:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c065c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.740214:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c065c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.740226:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c065c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574353.740259:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787574353.740392:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c065c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.740401:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c065c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.740408:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c065c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.740414:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574353.740419:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c065c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.740428:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c065c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.740443:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:1.0:1787574353.740447:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787574353.740451:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c065c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.740458:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c065c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.740522:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0655 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee80 expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.740533:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982a04da2c00) 00010000:00010000:1.0:1787574353.740536:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787574353.740546:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0655 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee80 expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.740560:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0c00, rc 0) 00000100:00100000:1.0:1787574353.740643:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+61:11607:x1874407272311808:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 669us (2406us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1787574353.740651:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 217 00000100:00100000:1.0:1787574353.744105:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574353.744197:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272311936 00000100:00100000:0.0:1787574353.744209:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272311936 00000100:00100000:0.0:1787574353.744274:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 218 00000100:00100000:0.0:1787574353.744285:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+61:11607:x1874407272311936:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787574353.744327:0:5831:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787574353.744447:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+61:11607:x1874407272311936:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 163us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574353.744464:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 218 00000100:00100000:0.0:1787574353.748663:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574353.749260:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272312192 00000100:00100000:1.0:1787574353.749274:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272312192 00000100:00100000:1.0:1787574353.749350:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 219 00000100:00100000:1.0:1787574353.749361:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+61:11607:x1874407272312192:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787574353.749386:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574353.749391:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787574353.749424:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142000/0xfe91058e646c05fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee64 expref: 61 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.749462:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:1.0:1787574353.749631:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787574353.749658:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c066a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee87 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787574353.750268:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1787574353.750749:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646c0671 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.750767:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646c0671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.750797:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646c0671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.750933:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c066a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee87 expref: 63 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.750954:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646c0671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee87 expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.750963:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982a04da2d00) 00010000:00010000:1.0:1787574353.750966:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787574353.750970:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0a00, rc 0) 00000100:00100000:1.0:1787574353.751077:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+62:11607:x1874407272312192:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1716us (2424us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1787574353.751086:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 219 00000100:00100000:1.0:1787574353.761418:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574353.761628:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272312448 00000100:00100000:3.0:1787574353.761643:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272312448 00000100:00100000:3.0:1787574353.761717:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 220 00000100:00100000:3.0:1787574353.761729:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+62:11607:x1874407272312448:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787574353.761804:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574353.761840:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646c0671 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee87 expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.761928:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982a04da2d00) 00010000:00010000:3.0:1787574353.761945:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574353.761983:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c067f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.762000:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c067f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.762011:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c067f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.762045:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0686 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x821b05d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.762053:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0686 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x821b05d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.762060:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0686 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x821b05d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.762153:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c067f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.762160:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c067f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.762200:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c067f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.762206:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574353.762210:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c067f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.762217:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c067f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.762227:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:3.0:1787574353.762229:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574353.762233:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c067f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.762238:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142400/0xfe91058e646c067f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.762255:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0686 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x821b05d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.762261:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0686 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x821b05d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.762266:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0686 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x821b05d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.762271:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574353.762274:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0686 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x821b05d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.762279:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0686 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x821b05d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.762286:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x821b05d1 (ffff982a04dc0800) 00010000:00010000:3.0:1787574353.762288:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574353.762291:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0686 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x821b05d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574353.762296:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142200/0xfe91058e646c0686 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x821b05d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574353.762466:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+61:11607:x1874407272312448:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 737us (1059us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787574353.762540:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 220 00000100:00100000:0.0:1787574353.769866:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574353.770021:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272312576 00000100:00100000:2.0:1787574353.770033:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272312576 00000100:00100000:2.0:1787574353.770105:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 221 00000100:00100000:2.0:1787574353.770118:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+61:11607:x1874407272312576:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787574353.770144:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574353.770194:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c068d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee8e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574353.770242:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c0694 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574353.770259:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c0694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574353.770272:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c0694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574353.770400:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c068d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee8e expref: 63 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574353.770421:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c0694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee8e expref: 62 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574353.770445:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982a03b34400) 00010000:00010000:2.0:1787574353.770448:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787574353.770452:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fb000, rc 0) 00000100:00100000:2.0:1787574353.770547:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+62:11607:x1874407272312576:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 430us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574353.770556:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 221 00000100:00100000:2.0:1787574353.782269:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574353.783080:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272312832 00000100:00100000:3.0:1787574353.783093:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272312832 00000100:00100000:3.0:1787574353.783155:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 222 00000100:00100000:3.0:1787574353.783218:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+62:11607:x1874407272312832:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787574353.783934:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c069b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574353.783952:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c069b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574353.783963:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c069b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787574353.784228:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1787574353.784239:0:5831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 329959072497ns, next at 330959069647ns, rc = 0 00000004:00010000:2.0:1787574353.784325:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000318aa75c reply state 00000000c2680141 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c069b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574353.784334:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787574353.785742:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+64:11607:x1874407272312832:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 2407us (3361us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787574353.785755:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 222 00010000:00010000:1.0:1787574353.789271:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c069b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.789294:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c069b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.789304:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c069b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.789311:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fb200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574353.789316:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c069b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.789347:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c069b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.789369:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982a03b34400) 00010000:00010000:1.0:1787574353.789373:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787574353.789379:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c069b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.789385:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c069b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574353.791834:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574353.792344:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272312960 00000100:00100000:1.0:1787574353.792361:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272312960 00000100:00100000:1.0:1787574353.792439:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 223 00000100:00100000:1.0:1787574353.792453:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+63:11607:x1874407272312960:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787574353.792785:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574353.792814:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c06a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee95 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.792904:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c06a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee95 expref: 64 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.792922:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c06a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee95 expref: 64 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.792948:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982a03b34400) 00010000:00010000:1.0:1787574353.792952:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787574353.792956:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0000, rc 0) 00000100:00100000:1.0:1787574353.793071:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+64:11607:x1874407272312960:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 620us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574353.793079:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 223 00000100:00100000:3.0:1787574353.799558:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574353.799785:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272313088 00000100:00100000:1.0:1787574353.799799:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272313088 00000100:00100000:1.0:1787574353.799892:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:1.0:1787574353.799907:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:2351:x1874407272313088:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787574353.800376:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+10:2351:x1874407272313088:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 470us (831us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1787574353.800386:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:2.0:1787574353.803356:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574353.803603:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272313344 00000100:00100000:1.0:1787574353.803620:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272313344 00000100:00100000:1.0:1787574353.803706:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:1.0:1787574353.803719:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+64:11607:x1874407272313344:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787574353.804051:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+65:11607:x1874407272313344:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 333us (704us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1787574353.804060:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:2.0:1787574353.811025:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574353.811207:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272313600 00000100:00100000:1.0:1787574353.811225:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272313600 00000100:00100000:1.0:1787574353.811317:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 224 00000100:00100000:1.0:1787574353.811333:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+65:11607:x1874407272313600:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787574353.811673:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+65:11607:x1874407272313600:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 344us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574353.811683:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 224 00000100:00100000:0.0:1787574353.820945:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574353.821114:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272313728 00000100:00100000:1.0:1787574353.821143:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272313728 00000100:00100000:1.0:1787574353.821242:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 225 00000100:00100000:1.0:1787574353.821253:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+65:11607:x1874407272313728:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787574353.821282:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574353.821315:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c06a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ee9c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.821421:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c06b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.821438:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c06b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.821452:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c06b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574353.821572:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787574353.821597:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c06b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.821634:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c06a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee9c expref: 67 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.821657:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c06b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee9c expref: 66 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.821668:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982a03b34400) 00010000:00010000:1.0:1787574353.821670:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787574353.821675:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0200, rc 0) 00000100:00100000:1.0:1787574353.821762:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+66:11607:x1874407272313728:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 509us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574353.821781:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 225 00000100:00100000:2.0:1787574353.834301:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574353.834415:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272313856 00000100:00100000:1.0:1787574353.834426:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272313856 00000100:00100000:1.0:1787574353.834507:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:1.0:1787574353.834519:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+10:2350:x1874407272313856:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787574353.834545:0:8472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574353.834573:0:8472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088939cf1/0xfe91058e646c06b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eea3 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787574353.834607:0:8472:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c3851, blocks: 0x1 00010000:00010000:1.0:1787574353.834629:0:8472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=330s v=(0 0) 00010000:00010000:1.0:1787574353.834634:0:8472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574353.834814:0:8472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088939cf1/0xfe91058e646c06b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eea3 expref: 11 pid: 8472 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.834841:0:8472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088939cf1/0xfe91058e646c06b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eea3 expref: 11 pid: 8472 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.834869:0:8472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0a00, rc 0) 00000100:00100000:1.0:1787574353.834941:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+11:2350:x1874407272313856:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 423us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574353.834948:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:2.0:1787574353.837840:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574353.838012:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272314112 00000100:00100000:0.0:1787574353.838025:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272314112 00000100:00100000:0.0:1787574353.838093:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 226 00000100:00100000:0.0:1787574353.838106:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+66:11607:x1874407272314112:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787574353.838271:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+66:11607:x1874407272314112:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 167us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574353.838279:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 226 00000100:00100000:0.0:1787574353.844703:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574353.844812:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272314240 00000100:00100000:1.0:1787574353.844826:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272314240 00000100:00100000:1.0:1787574353.844910:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:1.0:1787574353.844923:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+11:11607:x1874407272314240:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787574353.844966:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574353.845002:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000531a6873/0xfe91058e646c06be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eeaa expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.845049:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088939cf1/0xfe91058e646c06b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eea3 expref: 12 pid: 8472 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.845061:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574353.845067:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574353.845074:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000531a6873/0xfe91058e646c06be lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eeaa expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.845127:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088939cf1/0xfe91058e646c06b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eea3 expref: 12 pid: 8472 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.845145:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088939cf1/0xfe91058e646c06b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eea3 expref: 12 pid: 8472 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574353.845204:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41c19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1874407290122752:192.168.206.51@tcp:104: 00000100:00100000:1.0:1787574353.845349:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a069f8600 going to sleep for 11 seconds 00000100:00100000:0.0:1787574353.862280:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574353.862746:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272314368 00000100:00100000:2.0:1787574353.862757:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272314368 00010000:00010000:2.0:1787574353.862812:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088939cf1/0xfe91058e646c06b7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eea3 expref: 13 pid: 8472 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574353.862870:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:2.0:1787574353.862883:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+13:2351:x1874407272314368:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574353.862901:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574353.862930:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088939cf1/0xfe91058e646c06b7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eea3 expref: 13 pid: 8472 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574353.862947:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088939cf1/0xfe91058e646c06b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eea3 expref: 13 pid: 8472 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574353.862985:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574353.862991:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574353.863001:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000531a6873/0xfe91058e646c06be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eeaa expref: 13 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574353.863013:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000531a6873/0xfe91058e646c06be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eeaa expref: 13 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574353.863060:0:5815:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000531a6873/0xfe91058e646c06be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eeaa expref: 13 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574353.863101:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a2e0e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5815:1874407290122880:192.168.206.51@tcp:105: 00000100:00100000:2.0:1787574353.863235:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a06668a80 going to sleep for 11 seconds 00010000:00010000:1.0:1787574353.864253:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088939cf1/0xfe91058e646c06b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eea3 expref: 13 pid: 8472 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574353.864276:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41c19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1874407290122752:192.168.206.51@tcp:104: 00010000:00010000:1.0:1787574353.864319:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000531a6873/0xfe91058e646c06be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eeaa expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574353.864348:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0c00, rc 0) 00000100:00100000:1.0:1787574353.864412:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+12:11607:x1874407272314240:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 19490us (19723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574353.864422:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:2.0:1787574353.866934:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a2e0e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5815:1874407290122880:192.168.206.51@tcp:105: 00010000:00010000:2.0:1787574353.866968:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574353.867051:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+11:2351:x1874407272314368:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 4169us (4784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574353.867064:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:2.0:1787574353.868671:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574353.868805:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272314496 00000100:00100000:0.0:1787574353.868817:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272314496 00002000:00100000:0.0:1787574353.868891:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff982a2e0e1180 x1874407272314496/t0(0) o4->a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp:124/0 lens 504/0 e 0 to 0 dl 1787574364 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787574353.868903:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a2e0e1180 with x1874407272314496 ext(0->12) 00002000:00010000:0.0:1787574353.868910:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff982a2e0e1180 00000100:00100000:0.0:1787574353.868954:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:0.0:1787574353.868966:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a2e0e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+11:2351:x1874407272314496:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787574353.870089:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a2e0e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+13:2351:x1874407272314496:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 1118us (1423us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787574353.870101:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00002000:00100000:0.0:1787574353.870110:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff982a2e0e1180 x1874407272314496/t4294967320(0) o4->a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp:124/0 lens 504/448 e 0 to 0 dl 1787574364 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787574353.870120:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a2e0e1180 with x1874407272314496 ext(0->12) 00002000:00010000:0.0:1787574353.870125:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff982a2e0e1180 00000100:00100000:0.0:1787574353.874447:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574353.876159:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272314624 00000100:00100000:1.0:1787574353.876214:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272314624 00000100:00100000:1.0:1787574353.876293:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 227 00000100:00100000:1.0:1787574353.876488:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+66:11607:x1874407272314624:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787574354.025703:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967484 is committed 00000004:00080000:1.0:1787574354.025732:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1787574354.025769:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff982a064c33c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1787574354.025774:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982a4145ff00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff982a037713c0 00000020:00080000:1.0:1787574354.025778:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982a4145fb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff982907de9800 00000001:00080000:1.0:1787574354.025798:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1787574354.025816:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787574354.025840:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff982a069f86c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1787574354.025843:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982a09b06b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff982a069f89c0 00000020:00080000:1.0:1787574354.025846:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982a09b06900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff982a41c54000 00000020:00080000:3.0:1787574354.025934:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 4 00000020:00080000:3.0:1787574354.026223:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000004:00080000:1.0:1787574354.026712:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:1.0:1787574354.026757:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:1.0:1787574354.026846:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290123136:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787574354.026946:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290123008:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787574354.027045:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574354.027219:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290123008 00000100:00100000:3.0:1787574354.027229:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290123008 00000100:00100000:3.0:1787574354.027298:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787574354.027310:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a14c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3298:x1874407290123008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787574354.027344:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1787574354.027377:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c06c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.027405:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004af6f85e/0xfe91058e646c0487 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee09 expref: 12 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.027415:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1787574354.027420:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787574354.027426:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c06c5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.027458:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004af6f85e/0xfe91058e646c0487 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee09 expref: 12 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.027474:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004af6f85e/0xfe91058e646c0487 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee09 expref: 12 pid: 8472 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574354.027502:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6682:1874407290123264:192.168.206.51@tcp:104: 00000100:00100000:1.0:1787574354.027763:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574354.027800:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290123136 00000100:00100000:1.0:1787574354.027810:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290123136 00000100:00100000:1.0:1787574354.027845:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787574354.028001:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290123392:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787574354.028035:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574354.028151:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290123136:12345-0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1787574354.028228:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787574354.028234:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574354.028385:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+20:11607:x1874407272314624:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 151899us (153951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574354.028395:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 227 00002000:00080000:1.0:1787574354.028477:0:8472:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1787574354.028515:0:8472:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8c384f, atime: 0x6a8c3850, ctime: 0x6a8c384f, blocks: 0xb 00010000:00010000:1.0:1787574354.028523:0:8472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088939cf1/0xfe91058e646c06cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.028536:0:8472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=330s v=(0 0) 00010000:00010000:1.0:1787574354.028539:0:8472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574354.028545:0:8472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088939cf1/0xfe91058e646c06cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.028563:0:8472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088939cf1/0xfe91058e646c06cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574354.028983:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a2e0fd3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787574354.029163:0:8472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088939cf1/0xfe91058e646c06cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.029201:0:8472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088939cf1/0xfe91058e646c06cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.029221:0:8472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574354.029957:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574354.029968:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088939cf1/0xfe91058e646c06cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574354.029990:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0a00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574354.029995:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088939cf1/0xfe91058e646c06cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574354.030006:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088939cf1/0xfe91058e646c06cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574354.030030:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088939cf1/0xfe91058e646c06cc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574354.030048:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088939cf1/0xfe91058e646c06cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574354.030073:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574354.030074:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574354.030076:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574354.031697:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1787574354.031715:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1787574354.031746:0:6683:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1787574354.031754:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290123392 00000100:00100000:0.0:1787574354.031766:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290123392 00000100:00100000:2.0:1787574354.033059:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574354.033287:0:12475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787574354.033304:0:12475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3300:x1874407290123392:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787574354.033508:0:12475:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787574354.033513:0:12475:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787574353 00002000:00010000:0.0:1787574354.033515:0:12475:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787574354.033518:0:12475:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787574353 -> 1787574353 00002000:00010000:0.0:1787574354.033520:0:12475:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787574354.034310:0:12475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3300:x1874407290123392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1005us (6267us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787574354.034332:0:12475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787574354.034600:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1874407290123136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6747us (6834us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787574354.034607:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787574354.035123:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1787574354.035132:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982905b5a680, transno 4294967307 00000004:00080000:0.0:1787574354.035149:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:0.0:1787574354.035197:0:3299:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff982a41c19180 x1874407290123136/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787574370 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787574354.035212:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982a41c19180/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787574354.035219:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290123136:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1787574354.037732:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982a41c31500/2, rc 0, transno 4294967321 00000100:00100000:0.0:1787574354.037752:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290123392:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787574354.039289:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272314752 00000100:00100000:3.0:1787574354.039306:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272314752 00010000:00010000:3.0:1787574354.039394:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004af6f85e/0xfe91058e646c0487 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee09 expref: 13 pid: 8472 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574354.039458:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:3.0:1787574354.039471:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+13:2351:x1874407272314752:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574354.039491:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574354.039498:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004af6f85e/0xfe91058e646c0487 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee09 expref: 13 pid: 8472 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.039514:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004af6f85e/0xfe91058e646c0487 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee09 expref: 13 pid: 8472 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.039546:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787574354.039551:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787574354.039559:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c06c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.039571:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c06c5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.039621:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1787574354.039741:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574354.041239:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+13:2351:x1874407272314752:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 1755us (8175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574354.041254:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 85 00010000:00010000:3.0:1787574354.041379:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004af6f85e/0xfe91058e646c0487 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee09 expref: 12 pid: 8472 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574354.041402:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6682:1874407290123264:192.168.206.51@tcp:104: 00010000:00010000:3.0:1787574354.041429:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c06c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.041454:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c06c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.041462:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c06c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.041475:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c06c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.041484:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c06c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.041507:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787574354.042439:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a14c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3298:x1874407290123008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15125us (15388us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787574354.042450:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:2.0:1787574354.042465:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982a41c32300/2, rc 0, transno 4294967322 00000100:00100000:2.0:1787574354.042555:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290123008:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787574354.047149:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574354.047192:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c06c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.047210:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142200 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574354.047216:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c06c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.047229:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c06c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.047258:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c06c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.047266:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003763ada1/0xfe91058e646c06c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.047294:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574354.047297:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574354.047298:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574354.047382:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574354.047518:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272314880 00000100:00100000:0.0:1787574354.047532:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272314880 00000100:00100000:0.0:1787574354.047606:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:0.0:1787574354.047620:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4122f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+12:2351:x1874407272314880:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787574354.150752:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:2.0:1787574354.150775:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:2.0:1787574354.150795:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:0.0:1787574354.151095:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4122f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2351:x1874407272314880:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 103463us (103703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574354.151109:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:1.0:1787574354.154782:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574354.154999:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272315136 00000100:00100000:0.0:1787574354.155014:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272315136 00000100:00100000:0.0:1787574354.155098:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 228 00000100:00100000:0.0:1787574354.155113:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+20:11607:x1874407272315136:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787574354.155234:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574354.155277:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0200/0xfe91058e646c06b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee9c expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.155325:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982a03b34400) 00010000:00010000:0.0:1787574354.155331:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574354.155374:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c06d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.155391:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c06d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.155403:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c06d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574354.155713:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f23faa75 reply state 000000009292baba transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c06d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574354.155726:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574354.155854:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+21:11607:x1874407272315136:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 743us (1087us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1787574354.155873:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 228 00000100:00100000:0.0:1787574354.158935:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1787574354.160574:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c06d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.160596:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c06d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.160603:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c06d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.160631:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574354.160702:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c06d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.160712:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c06d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.160734:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982a03b34400) 00010000:00010000:1.0:1787574354.160738:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574354.160743:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c06d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.160750:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01000/0xfe91058e646c06d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574354.160912:0:12475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272315264 00000100:00100000:2.0:1787574354.160927:0:12475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272315264 00000100:00100000:3.0:1787574354.161131:0:12475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:3.0:1787574354.161145:0:12475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2350:x1874407272315264:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787574354.161500:0:12475:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787574354.161504:0:12475:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787574353 -> 1787574352 00002000:00010000:3.0:1787574354.161507:0:12475:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787574352 00002000:00010000:3.0:1787574354.161509:0:12475:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787574353 -> 1787574352 00002000:00010000:3.0:1787574354.161511:0:12475:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787574354.161603:0:12475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2350:x1874407272315264:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 460us (2681us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787574354.161612:0:12475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:2.0:1787574354.164251:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574354.164335:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272315520 00000100:00100000:1.0:1787574354.164347:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272315520 00000100:00100000:1.0:1787574354.164417:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 229 00000100:00100000:1.0:1787574354.164429:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+20:11607:x1874407272315520:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787574354.164527:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c06da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.164546:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c0694 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee8e expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.164557:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c06da lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.164602:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c0694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee8e expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.164633:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c0694 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee8e expref: 20 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574354.164663:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11bb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874407290123520:192.168.206.51@tcp:104: 00000100:00100000:1.0:1787574354.164914:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787574354.168029:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574354.168144:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11bb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1874407290123520:192.168.206.51@tcp:104: 00010000:00010000:1.0:1787574354.168197:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c06da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574354.168314:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272315648 00000100:00100000:3.0:1787574354.168324:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272315648 00010000:00010000:3.0:1787574354.168370:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c0694 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee8e expref: 21 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574354.168412:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:3.0:1787574354.168423:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+21:2350:x1874407272315648:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574354.168439:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574354.168446:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c0694 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee8e expref: 21 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.168469:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c0694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee8e expref: 21 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.168512:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb000/0xfe91058e646c0694 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee8e expref: 21 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.168528:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982a03b34400) 00010000:00010000:3.0:1787574354.168532:0:8453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c06da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.168541:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c06da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.168548:0:8453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c06da lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.168579:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574354.168660:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+20:2350:x1874407272315648:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 238us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574354.168668:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 86 00010000:00010000:1.0:1787574354.169022:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c06da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.169030:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c06da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.169074:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c06da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.169082:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c06da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.169090:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c06da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.169097:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574354.169102:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c06da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.169126:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c06da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.169139:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982a03b34400) 00010000:00010000:1.0:1787574354.169143:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787574354.169148:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c06da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.169156:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0400/0xfe91058e646c06da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574354.169258:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:11607:x1874407272315520:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 4830us (5020us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787574354.169267:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 229 00000100:00100000:2.0:1787574354.174025:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574354.174212:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272315776 00000100:00100000:1.0:1787574354.174227:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272315776 00000100:00100000:1.0:1787574354.174296:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:1.0:1787574354.174309:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2351:x1874407272315776:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787574354.174367:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000022424585/0xfe91058e646c06e1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.174394:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000531a6873/0xfe91058e646c06be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eeaa expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.174404:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574354.174409:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787574354.174414:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022424585/0xfe91058e646c06e1 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.174492:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000531a6873/0xfe91058e646c06be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eeaa expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.174508:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000531a6873/0xfe91058e646c06be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eeaa expref: 8 pid: 6681 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574354.174527:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11bb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1874407290123648:192.168.206.51@tcp:104: 00000100:00100000:1.0:1787574354.174626:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574354.179783:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574354.179980:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11bb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1874407290123648:192.168.206.51@tcp:104: 00010000:00010000:1.0:1787574354.180016:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000022424585/0xfe91058e646c06e1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574354.180214:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272315904 00000100:00100000:2.0:1787574354.180223:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272315904 00010000:00010000:2.0:1787574354.180271:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000531a6873/0xfe91058e646c06be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eeaa expref: 9 pid: 6681 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574354.180318:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:2.0:1787574354.180329:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+9:2350:x1874407272315904:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574354.180348:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574354.180377:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000531a6873/0xfe91058e646c06be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eeaa expref: 9 pid: 6681 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574354.180406:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000531a6873/0xfe91058e646c06be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eeaa expref: 9 pid: 6681 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574354.180436:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000531a6873/0xfe91058e646c06be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eeaa expref: 9 pid: 6681 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574354.180465:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574354.180470:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574354.180477:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000022424585/0xfe91058e646c06e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574354.180488:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022424585/0xfe91058e646c06e1 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574354.180520:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574354.180593:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2350:x1874407272315904:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 265us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574354.180602:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 87 00010000:00010000:1.0:1787574354.180953:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000022424585/0xfe91058e646c06e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.180963:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022424585/0xfe91058e646c06e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.181000:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000022424585/0xfe91058e646c06e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.181008:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022424585/0xfe91058e646c06e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.181028:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022424585/0xfe91058e646c06e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.181036:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1e00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574354.181041:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022424585/0xfe91058e646c06e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.181050:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022424585/0xfe91058e646c06e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.181075:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022424585/0xfe91058e646c06e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.181083:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022424585/0xfe91058e646c06e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574354.181153:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2351:x1874407272315776:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 6845us (7142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574354.181160:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:3.0:1787574354.185841:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574354.185953:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272316160 00000100:00100000:0.0:1787574354.185966:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272316160 00000100:00100000:0.0:1787574354.186055:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 230 00000100:00100000:0.0:1787574354.186078:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:11607:x1874407272316160:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787574354.186229:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c06e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.186255:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c06e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.186292:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c06e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.186626:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c06ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.186654:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c06a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee95 expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.186663:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c06ef lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.186706:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c06a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee95 expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.186723:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c06a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee95 expref: 20 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574354.186740:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874407290123776:192.168.206.51@tcp:104: 00000100:00100000:0.0:1787574354.186851:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff98290619cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574354.193709:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574354.193858:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874407290123776:192.168.206.51@tcp:104: 00010000:00010000:1.0:1787574354.193893:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c06ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574354.194987:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272316288 00000100:00100000:3.0:1787574354.195001:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272316288 00010000:00010000:3.0:1787574354.195057:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c06a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee95 expref: 21 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574354.195249:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:3.0:1787574354.195261:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a063ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+21:2351:x1874407272316288:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574354.195281:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574354.195307:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c06a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee95 expref: 21 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.195321:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c06a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee95 expref: 21 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.195349:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0000/0xfe91058e646c06a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee95 expref: 21 pid: 5830 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.195366:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982a03b34400) 00010000:00010000:3.0:1787574354.195372:0:8453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c06ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.195382:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c06ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.195390:0:8453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c06ef lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.195417:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574354.195516:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a063ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+20:2351:x1874407272316288:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 248us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574354.195525:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 88 00010000:00010000:1.0:1787574354.195648:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c06ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.195668:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c06ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787574354.195879:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1787574354.196055:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1787574354.196113:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1787574354.196249:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11bb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5831:1874407290123904:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787574354.196312:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574354.196353:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574354.196469:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290123904 00000100:00100000:2.0:1787574354.196479:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290123904 00000100:00100000:2.0:1787574354.196529:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787574354.196539:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5831:x1874407290123904:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787574354.196646:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5831:x1874407290123904:12345-0@lo:1000:mdt00_001.0 Request processed in 109us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574354.196654:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787574354.196717:0:5831:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1787574354.196724:0:5831:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:1.0:1787574354.196748:0:5831:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982a41c31500, transno 4294967321 00000004:00080000:1.0:1787574354.196760:0:5831:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982a41c32300, transno 4294967322 00000100:00100000:1.0:1787574354.196767:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11bb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5831:1874407290123904:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787574354.199598:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1787574354.199768:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5831:1874407290124032:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787574354.199848:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574354.199925:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff98290619c000 going to sleep for 11 seconds 00000100:00100000:1.0:1787574354.200000:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290124032 00000100:00100000:1.0:1787574354.200009:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290124032 00000100:00100000:2.0:1787574354.200158:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787574354.200287:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5831:x1874407290124032:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787574354.200553:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5831:x1874407290124032:12345-0@lo:1000:mdt00_001.0 Request processed in 273us (703us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787574354.200562:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787574354.200727:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5831:1874407290124032:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787574354.200775:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c06ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.200788:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c06ef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.200797:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c06ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.200805:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01a00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574354.200811:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c06ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.200831:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c06ef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.200854:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982a03b34400) 00010000:00010000:1.0:1787574354.200857:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787574354.200864:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c06ef lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.200870:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01a00/0xfe91058e646c06ef lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.200907:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0632 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.200914:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0632 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.200920:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0632 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.200926:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16143800 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574354.200929:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0632 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.200936:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0632 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.200945:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:1.0:1787574354.200947:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787574354.200956:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c0639 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee79 expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.200990:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c0639 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee79 expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.200999:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c0639 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee79 expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.201035:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c0639 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee79 expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574354.201050:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11bb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874407290124160:192.168.206.51@tcp:105: 00000100:00100000:1.0:1787574354.201223:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a056b6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574354.204316:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574354.204384:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272316416 00000100:00100000:3.0:1787574354.204397:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272316416 00000100:00100000:3.0:1787574354.204476:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:3.0:1787574354.204488:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+24:11606:x1874407272316416:12345-192.168.206.51@tcp:49:lfs.0 00000100:00100000:3.0:1787574354.204647:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+24:11606:x1874407272316416:12345-192.168.206.51@tcp:49:lfs.0 Request processed in 155us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574354.204671:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:1.0:1787574354.206572:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11bb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874407290124160:192.168.206.51@tcp:105: 00010000:00010000:1.0:1787574354.206619:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0632 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.206631:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143800/0xfe91058e646c0632 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.206696:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c06f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.206712:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c06f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.206726:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c06f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.206739:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c06f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.206762:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c06f6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.206769:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c06f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.206775:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1e00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574354.206780:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c06f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.206787:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c06f6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.206802:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:1.0:1787574354.206805:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574354.206809:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c06f6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.206815:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1e00/0xfe91058e646c06f6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.206826:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c06e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.206832:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c06e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.206839:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c06e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.206843:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00e00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574354.206856:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c06e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.206863:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c06e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.206872:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:1.0:1787574354.206875:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787574354.206877:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c06e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.206884:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00e00/0xfe91058e646c06e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574354.208152:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574354.208275:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272316672 00000100:00100000:3.0:1787574354.208288:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272316672 00000100:00100000:3.0:1787574354.208352:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 231 00000100:00100000:3.0:1787574354.208364:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+24:11606:x1874407272316672:12345-192.168.206.51@tcp:58:lfs.0 00000040:00080000:3.0:1787574354.208782:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787574354.208889:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+24:11606:x1874407272316672:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 526us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574354.208898:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 231 00000100:00100000:0.0:1787574354.209256:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+23:11607:x1874407272316160:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 23186us (23428us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1787574354.209277:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 230 00000020:00080000:0.0:1787574354.209282:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787574354.210390:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787574354.210398:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787574354.210460:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787574354.210468:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787574354.210608:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874407290124288:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787574354.210714:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a2e0fd480 going to sleep for 11 seconds 00000100:00100000:2.0:1787574354.217438:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574354.218029:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272316928 00000100:00100000:3.0:1787574354.218031:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874407290124288:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787574354.218040:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272316928 00000100:00100000:1.0:1787574354.218125:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:1.0:1787574354.218138:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0327dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+23:11607:x1874407272316928:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787574354.219009:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:2.0:1787574354.219418:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000001:00080000:0.0:1787574354.219485:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1787574354.219559:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c06fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.219582:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c06fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.219596:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c06fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.219606:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c06fd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.219613:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c06fd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.219621:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c06fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574354.219683:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272317056 00000100:00100000:3.0:1787574354.219693:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272317056 00000100:00100000:3.0:1787574354.219753:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 232 00000100:00100000:3.0:1787574354.219765:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+26:11608:x1874407272317056:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787574354.219796:0:7646:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787574354.219931:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+26:11608:x1874407272317056:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 168us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574354.219939:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 232 00010000:00010000:0.0:1787574354.219998:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787574354.220269:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0327dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+25:11607:x1874407272316928:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 2133us (2845us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787574354.220278:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00000020:00080000:0.0:1787574354.220282:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787574354.230728:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574354.230746:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c06fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574354.230759:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00c00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574354.230764:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c06fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574354.230774:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c06fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574354.230798:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982a0de1de00) 00010000:00010000:2.0:1787574354.230802:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787574354.230806:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c06fd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574354.230811:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00c00/0xfe91058e646c06fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574354.230840:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574354.230842:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574354.230843:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574354.235539:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574354.235736:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272317312 00000100:00100000:0.0:1787574354.235749:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272317312 00000100:00100000:0.0:1787574354.235822:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 233 00000100:00100000:0.0:1787574354.235834:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+25:11608:x1874407272317312:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574354.235877:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574354.235905:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00200/0xfe91058e646c0704 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eeb1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.236043:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c070b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.236060:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c070b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.236072:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c070b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574354.236085:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787574354.236282:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00200/0xfe91058e646c0704 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eeb1 expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.236303:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c070b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eeb1 expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.236312:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:0.0:1787574354.236315:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787574354.236319:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a41d00400, rc 0) 00000100:00100000:0.0:1787574354.236404:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+27:11608:x1874407272317312:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 572us (877us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787574354.236412:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 233 00000100:00100000:1.0:1787574354.245147:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574354.245235:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272317568 00000100:00100000:3.0:1787574354.245265:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272317568 00000100:00100000:3.0:1787574354.245340:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 234 00000100:00100000:3.0:1787574354.245352:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+27:11608:x1874407272317568:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787574354.245460:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0719 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.245482:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0719 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.245496:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0719 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.245743:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0719 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.245752:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0719 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.245759:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0719 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.245766:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574354.245771:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0719 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.245780:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0719 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.245795:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:3.0:1787574354.245798:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787574354.245804:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0719 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574354.245824:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16142600/0xfe91058e646c0719 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574354.246030:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+28:11608:x1874407272317568:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 675us (893us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1787574354.246040:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 234 00000040:00080000:0.0:1787574354.246712:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787574354.246719:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787574354.247256:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787574354.247273:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787574354.249009:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574354.249100:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272317696 00000100:00100000:0.0:1787574354.249116:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272317696 00000100:00100000:0.0:1787574354.249217:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 235 00000100:00100000:0.0:1787574354.249230:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+28:11610:x1874407272317696:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1787574354.249257:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574354.249288:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00200/0xfe91058e646c0720 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eeb8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.249373:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0727 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.249389:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0727 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.249404:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0727 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.249422:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646c072e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.249430:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646c072e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.249436:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646c072e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.250002:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c0735 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.250016:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0624 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee72 expref: 29 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.250037:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c0735 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.250244:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0624 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee72 expref: 29 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.250263:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0624 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee72 expref: 29 pid: 7646 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574354.250282:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874407290124416:192.168.206.51@tcp:104: 00000100:00100000:0.0:1787574354.251064:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff98290619c000 going to sleep for 11 seconds 00000100:00100000:1.0:1787574354.253412:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574354.253748:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272317952 00000100:00100000:3.0:1787574354.253763:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272317952 00000100:00100000:3.0:1787574354.253943:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:3.0:1787574354.253957:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+30:11608:x1874407272317952:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787574354.255075:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+31:11608:x1874407272317952:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 1112us (1667us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1787574354.255370:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:0.0:1787574354.256369:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1874407290124416:192.168.206.51@tcp:104: 00010000:00010000:0.0:1787574354.256403:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c0735 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574354.257224:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574354.257349:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272318208 00000100:00100000:0.0:1787574354.257358:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272318208 00000100:00100000:0.0:1787574354.257606:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:0.0:1787574354.257619:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+31:6048:x1874407272318208:12345-192.168.206.51@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787574354.257956:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+32:6048:x1874407272318208:12345-192.168.206.51@tcp:35:ldlm_bl.0 Request processed in 339us (736us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1787574354.257965:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:2.0:1787574354.261036:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574354.261139:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272318336 00000100:00100000:1.0:1787574354.261152:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272318336 00010000:00010000:1.0:1787574354.261228:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0624 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee72 expref: 32 pid: 7646 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574354.261277:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:1.0:1787574354.261290:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+32:2350:x1874407272318336:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574354.261306:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574354.261316:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0624 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee72 expref: 32 pid: 7646 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.261349:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0624 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee72 expref: 32 pid: 7646 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.261380:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0624 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee72 expref: 32 pid: 7646 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.261402:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:1.0:1787574354.261409:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c0735 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.261420:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c0735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.261429:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c0735 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574354.261466:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574354.261549:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+31:2350:x1874407272318336:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 262us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574354.261558:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 89 00010000:00010000:0.0:1787574354.262155:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c0735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.262197:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c0735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574354.262266:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787574354.262271:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787574354.262297:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c0735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.262312:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c0735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.262322:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0727 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.262329:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0727 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.262336:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0727 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.262342:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00800 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574354.262346:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0727 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.262353:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0727 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.262367:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:0.0:1787574354.262370:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574354.262374:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0727 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.262380:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0727 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.262404:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646c072e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.262411:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646c072e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.262417:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646c072e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.262421:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574354.262424:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646c072e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.262430:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646c072e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.262437:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982a0de1d700) 00010000:00010000:0.0:1787574354.262440:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574354.262443:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646c072e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.262448:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00600/0xfe91058e646c072e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.262495:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00200/0xfe91058e646c0720 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eeb8 expref: 31 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.262509:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c0735 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eeb8 expref: 30 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574354.262527:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:0.0:1787574354.262529:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574354.262532:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a41d01e00, rc 0) 00000100:00100000:0.0:1787574354.263333:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+30:11610:x1874407272317696:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 14098us (14327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574354.263343:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 235 00010000:00010000:2.0:1787574354.673902:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787574355.171762:0:12513:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787574355.171777:0:12513:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787574355.171834:0:12513:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787574355.171841:0:12513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787574355.409532:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574355.409639:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272318592 00000100:00100000:1.0:1787574355.409653:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272318592 00000100:00100000:1.0:1787574355.409751:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 236 00000100:00100000:1.0:1787574355.409764:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+30:11633:x1874407272318592:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1787574355.409798:0:7646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574355.409827:0:7646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c073c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eebf expref: -99 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574355.410003:0:7646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c0743 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574355.410022:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c0743 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574355.410037:0:7646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c0743 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574355.410051:0:7646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787574355.410237:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c073c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eebf expref: 33 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574355.410259:0:7646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c0743 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eebf expref: 32 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574355.410269:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:1.0:1787574355.410273:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787574355.410277:0:7646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0600, rc 0) 00000100:00100000:1.0:1787574355.410357:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+32:11633:x1874407272318592:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 595us (839us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1787574355.410365:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 236 00000100:00080000:2.0:1787574355.410584:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574355.413741:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574355.416094:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272318720 00000100:00100000:0.0:1787574355.416113:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272318720 00000100:00100000:0.0:1787574355.416309:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 237 00000100:00100000:0.0:1787574355.416323:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+32:11633:x1874407272318720:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:0.0:1787574355.416429:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0751 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574355.416451:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574355.416465:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574355.416501:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574355.416508:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0751 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574355.416516:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0751 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574355.416522:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00800 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574355.416541:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0751 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574355.416549:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0751 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574355.416564:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:0.0:1787574355.416568:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787574355.416573:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0751 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574355.416579:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00800/0xfe91058e646c0751 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574355.416688:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+32:11633:x1874407272318720:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 367us (2959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574355.416697:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 237 00000100:00100000:1.0:1787574355.509630:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574355.509678:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272318848 00000100:00100000:1.0:1787574355.509693:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272318848 00000100:00100000:1.0:1787574355.509763:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:1.0:1787574355.509775:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2352:x1874407272318848:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:1.0:1787574355.509816:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574355.509845:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055c3eb3e/0xfe91058e646c0758 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eec6 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787574355.509882:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8c3850, atime: 0x6a8c3850, ctime: 0x6a8c3850, blocks: 0xb 00010000:00010000:1.0:1787574355.509909:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=331s v=(0 0) 00010000:00010000:1.0:1787574355.509915:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574355.509926:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055c3eb3e/0xfe91058e646c0758 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eec6 expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574355.509949:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055c3eb3e/0xfe91058e646c0758 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eec6 expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574355.509977:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1000, rc 0) 00000100:00100000:1.0:1787574355.510050:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2352:x1874407272318848:12345-192.168.206.51@tcp:101:cat.0 Request processed in 276us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574355.510058:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:2.0:1787574355.514781:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574355.515199:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272318976 00000100:00100000:0.0:1787574355.515290:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272318976 00002000:00100000:0.0:1787574355.515483:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff982a41c30e00 x1874407272318976/t0(0) o3->a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp:126/0 lens 488/0 e 0 to 0 dl 1787574366 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787574355.515497:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a41c30e00 with x1874407272318976 ext(0->4095) 00002000:00010000:0.0:1787574355.515504:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff982a41c30e00 00000100:00100000:0.0:1787574355.515545:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:0.0:1787574355.515557:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2353:x1874407272318976:12345-192.168.206.51@tcp:3:cat.0 00000100:00100000:0.0:1787574355.515821:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2353:x1874407272318976:12345-192.168.206.51@tcp:3:cat.0 Request processed in 264us (1053us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787574355.515831:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00002000:00100000:0.0:1787574355.515854:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff982a41c30e00 x1874407272318976/t0(0) o3->a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f@192.168.206.51@tcp:126/0 lens 488/4536 e 0 to 0 dl 1787574366 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787574355.515863:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982a41c30e00 with x1874407272318976 ext(0->4095) 00002000:00010000:0.0:1787574355.515867:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff982a41c30e00 00010000:00010000:2.0:1787574355.700271:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574356.082478:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290124544:0@lo:400:kworker.0 00000100:00100000:2.0:1787574356.082577:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574356.082663:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a418f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874407290125056:0@lo:400:kworker.0 00000100:00100000:2.0:1787574356.082695:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574356.082726:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574356.082732:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a418f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290124928:0@lo:400:kworker.0 00000100:00100000:2.0:1787574356.082761:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574356.082902:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41dbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290124672:0@lo:400:kworker.0 00000100:00100000:3.0:1787574356.082939:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574356.082980:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a418fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290125184:0@lo:400:kworker.0 00000100:00100000:3.0:1787574356.083005:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574356.083028:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574356.083034:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982906428380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290124800:0@lo:400:kworker.0 00000100:00100000:3.0:1787574356.083079:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574356.083112:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290124928 00000100:00100000:3.0:1787574356.083121:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290124928 00000100:00100000:3.0:1787574356.083226:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290125184 00000100:00100000:3.0:1787574356.083231:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290125184 00000100:00100000:3.0:1787574356.083259:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787574356.083270:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1874407290124928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574356.083350:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1874407290124928:12345-0@lo:400:kworker.0 Request processed in 81us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574356.083358:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787574356.083446:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787574356.083454:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3298:x1874407290125184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574356.083490:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3298:x1874407290125184:12345-0@lo:400:kworker.0 Request processed in 37us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574356.083496:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1787574356.083515:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787574356.083520:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574356.083559:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a418fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290125184:0@lo:400:kworker.0 00000100:00100000:3.0:1787574356.083593:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a418f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290124928:0@lo:400:kworker.0 00000100:00100000:0.0:1787574356.083753:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290125056 00000100:00100000:0.0:1787574356.083757:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290125056 00000100:00100000:0.0:1787574356.083796:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290124672 00000100:00100000:0.0:1787574356.083799:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290124672 00000100:00100000:0.0:1787574356.083810:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290124800 00000100:00100000:0.0:1787574356.083812:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290124800 00000100:00100000:0.0:1787574356.083825:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787574356.083831:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874407290125056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574356.083873:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874407290125056:12345-0@lo:400:kworker.0 Request processed in 42us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574356.083879:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787574356.083894:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787574356.083901:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290124672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574356.083933:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290124672:12345-0@lo:400:kworker.0 Request processed in 33us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574356.083939:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787574356.083955:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787574356.083970:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290124800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574356.084000:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290124800:12345-0@lo:400:kworker.0 Request processed in 40us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574356.084006:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:0.0:1787574356.084037:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574356.084057:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982906428380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290124800:0@lo:400:kworker.0 00000100:00100000:0.0:1787574356.084082:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41dbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290124672:0@lo:400:kworker.0 00000100:00100000:0.0:1787574356.084111:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a418f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874407290125056:0@lo:400:kworker.0 00000100:00100000:1.0:1787574356.084519:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290124544 00000100:00100000:1.0:1787574356.084526:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290124544 00000100:00100000:1.0:1787574356.084574:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787574356.084582:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:3301:x1874407290124544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574356.084641:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7182851c-b624-4982-87cf-e891100b1765+19:3301:x1874407290124544:12345-0@lo:400:kworker.0 Request processed in 60us (2065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574356.084648:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787574356.084705:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290124544:0@lo:400:kworker.0 00000100:00100000:2.0:1787574356.594557:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574356.594585:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290125312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574356.594688:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574356.594760:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290125312 00000100:00100000:2.0:1787574356.594770:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290125312 00000100:00100000:2.0:1787574356.594827:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787574356.594838:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a4158ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1874407290125312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787574356.594882:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787574356.594933:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a4158ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1874407290125312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574356.594954:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787574356.595266:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290125312:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787574356.721574:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574357.277530:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574357.277577:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574357.277616:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574357.277643:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574357.277666:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574357.277701:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272319104 00000100:00100000:1.0:1787574357.277701:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272319232 00000100:00100000:3.0:1787574357.277714:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272319104 00000100:00100000:1.0:1787574357.277714:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272319232 00000100:00100000:1.0:1787574357.277775:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272319616 00000100:00100000:1.0:1787574357.277779:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272319616 00000100:00100000:3.0:1787574357.277781:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 297 00000100:00100000:3.0:1787574357.277796:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+13:2351:x1874407272319104:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574357.277804:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 156 00000100:00100000:1.0:1787574357.277814:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+32:2351:x1874407272319232:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574357.277906:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 157 00000100:00100000:0.0:1787574357.277916:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2351:x1874407272319616:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574357.277981:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+32:2351:x1874407272319232:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 169us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574357.277990:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 156 00000100:00080000:1.0:1787574357.278013:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574357.278099:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272319488 00000100:00100000:2.0:1787574357.278104:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272319488 00000100:00100000:3.0:1787574357.278145:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9891405-66e8-4ae2-851e-6434ae47d085+13:2351:x1874407272319104:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 352us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574357.278147:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272319360 00000100:00100000:2.0:1787574357.278152:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272319360 00000100:00100000:3.0:1787574357.278158:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 297 00000100:00100000:2.0:1787574357.278209:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:2.0:1787574357.278221:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2351:x1874407272319488:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574357.278256:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:2.0:1787574357.278257:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2351:x1874407272319488:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 38us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574357.278270:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:3.0:1787574357.278272:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2351:x1874407272319360:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574357.278309:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+8:2351:x1874407272319360:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 44us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574357.278315:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00080000:1.0:1787574357.278438:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787574357.278442:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787574357.278760:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f782322b-3b13-413b-a1b9-4500fa873ef8+5:2351:x1874407272319616:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 843us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574357.278768:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 157 00000100:00100000:2.0:1787574357.623491:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290125440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574357.623588:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574357.625498:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290125440 00000100:00100000:0.0:1787574357.625517:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290125440 00000100:00100000:0.0:1787574357.625593:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787574357.625607:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874407290125440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574357.625660:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574357.625767:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874407290125440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (2178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574357.625775:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787574357.625885:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290125440:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787574357.745662:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787574358.731608:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:2.0:1787574358.769834:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787574359.243463:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:1.0:1787574359.243488:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff982a056b6cc0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787574359.243494:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982a09b06100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff982a056b6f00 00000020:00080000:1.0:1787574359.243498:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982a09b06200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff982907deac00 00000020:00080000:1.0:1787574359.243520:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:1.0:1787574359.243986:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000001:00080000:3.0:1787574359.244110:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1787574359.244148:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:2.0:1787574359.244495:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1787574359.244507:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:2.0:1787574359.804281:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574360.545465:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574360.545752:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272319744 00000100:00100000:0.0:1787574360.545762:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272319744 00000100:00100000:0.0:1787574360.545849:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 238 00000100:00080000:1.0:1787574360.545858:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574360.545865:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:11295:x1874407272319744:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787574360.545994:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:11295:x1874407272319744:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 135us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574360.546002:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 238 00000100:00100000:3.0:1787574360.559902:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574360.561590:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272320000 00000100:00100000:0.0:1787574360.561604:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272320000 00000100:00100000:0.0:1787574360.561664:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:0.0:1787574360.561675:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:11295:x1874407272320000:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787574360.562264:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+20:11295:x1874407272320000:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 588us (2369us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787574360.562282:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:1.0:1787574360.754828:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574360.754950:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272320128 00000100:00100000:2.0:1787574360.754963:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272320128 00000100:00080000:1.0:1787574360.755112:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574360.755157:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 239 00000100:00100000:2.0:1787574360.755215:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f782322b-3b13-413b-a1b9-4500fa873ef8+5:12085:x1874407272320128:12345-192.168.206.51@tcp:101:lsof.0 00010000:00010000:2.0:1787574360.755243:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574360.755271:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c075f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eecd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574360.755362:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c0766 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574360.755395:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c0766 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574360.755862:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c0766 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574360.756111:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787574360.756116:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787574360.756234:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c0766 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574360.756274:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c075f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eecd expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574360.756297:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c0766 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eecd expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574360.756307:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34000) 00010000:00010000:2.0:1787574360.756310:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787574360.756314:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fb600, rc 0) 00000100:00100000:2.0:1787574360.756404:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f782322b-3b13-413b-a1b9-4500fa873ef8+6:12085:x1874407272320128:12345-192.168.206.51@tcp:101:lsof.0 Request processed in 1235us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574360.756812:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 239 00010000:00010000:2.0:1787574360.823082:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574361.203109:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874407290125824:0@lo:400:kworker.0 00000100:00100000:0.0:1787574361.203198:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290125696:0@lo:400:kworker.0 00000100:00100000:3.0:1787574361.203227:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574361.203297:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290125568:0@lo:400:kworker.0 00000100:00100000:2.0:1787574361.203362:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290125952:0@lo:400:kworker.0 00000100:00100000:1.0:1787574361.211249:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574361.211356:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874407290126080:0@lo:400:kworker.0 00000100:00100000:1.0:1787574361.211402:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574361.211464:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290125568 00000100:00100000:1.0:1787574361.211486:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290125568 00000100:00100000:1.0:1787574361.211546:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787574361.211557:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:3301:x1874407290125568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574361.211622:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7182851c-b624-4982-87cf-e891100b1765+19:3301:x1874407290125568:12345-0@lo:400:kworker.0 Request processed in 66us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574361.211629:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787574361.211672:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290125824 00000100:00100000:1.0:1787574361.211676:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290125824 00000100:00100000:1.0:1787574361.211716:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290126080 00000100:00100000:1.0:1787574361.211719:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290126080 00000100:00100000:1.0:1787574361.211749:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787574361.211757:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874407290125824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574361.211794:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874407290125824:12345-0@lo:400:kworker.0 Request processed in 38us (8568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574361.211800:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787574361.211812:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787574361.211818:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a418fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874407290126080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574361.211846:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a418fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874407290126080:12345-0@lo:400:kworker.0 Request processed in 29us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574361.212611:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1787574361.212646:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574361.212687:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290125568:0@lo:400:kworker.0 00000100:00100000:1.0:1787574361.212703:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874407290126080:0@lo:400:kworker.0 00000100:00100000:2.0:1787574361.219532:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574361.219988:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290125952 00000100:00100000:1.0:1787574361.220002:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290125952 00000100:00100000:1.0:1787574361.220092:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787574361.220117:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290125952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574361.220215:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290125952:12345-0@lo:400:kworker.0 Request processed in 112us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574361.220223:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1787574361.220969:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574361.221016:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1787574361.221040:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1787574361.221072:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290125952:0@lo:400:kworker.0 00000100:00100000:3.0:1787574361.224608:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874407290125824:0@lo:400:kworker.0 00000100:00100000:0.0:1787574361.227845:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574361.227931:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11be2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290126208:0@lo:400:kworker.0 00000100:00100000:0.0:1787574361.228022:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574361.228585:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290126208 00000100:00100000:3.0:1787574361.228598:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290126208 00000100:00100000:3.0:1787574361.228682:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787574361.228694:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290126208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574361.228764:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290126208:12345-0@lo:400:kworker.0 Request processed in 72us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574361.228772:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1787574361.228838:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787574361.229021:0:3298:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787574361.229028:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982a41c19180, transno 4294967310 00000100:00100000:0.0:1787574361.229050:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11be2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290126208:0@lo:400:kworker.0 00000100:00100000:1.0:1787574361.229369:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290125696 00000100:00100000:1.0:1787574361.229376:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290125696 00000100:00100000:1.0:1787574361.229423:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787574361.229433:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290125696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574361.229506:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290125696:12345-0@lo:400:kworker.0 Request processed in 73us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574361.229514:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787574361.229673:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290125696:0@lo:400:kworker.0 00000100:00100000:3.0:1787574361.713888:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290126336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574361.714010:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574361.714252:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290126336 00000100:00100000:2.0:1787574361.714262:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290126336 00000100:00100000:2.0:1787574361.714328:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787574361.714340:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290126336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787574361.714385:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787574361.714463:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290126336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574361.714471:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787574361.717063:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290126336:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787574361.845527:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574362.394145:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574362.394226:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574362.394291:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574362.394312:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574362.394339:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574362.394432:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272320512 00000100:00100000:1.0:1787574362.394436:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272320256 00000100:00100000:2.0:1787574362.394446:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272320512 00000100:00100000:1.0:1787574362.394447:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272320256 00000100:00100000:2.0:1787574362.394516:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272320640 00000100:00100000:1.0:1787574362.394521:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 299 00000100:00100000:2.0:1787574362.394522:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272320640 00000100:00100000:1.0:1787574362.394537:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:2351:x1874407272320256:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574362.394554:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:2.0:1787574362.394564:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2351:x1874407272320512:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574362.394630:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+13:2351:x1874407272320256:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 96us (499us total) trans 0 rc 0/0 00000100:00080000:3.0:1787574362.394632:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787574362.394639:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574362.394644:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 299 00000100:00100000:3.0:1787574362.394672:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:3.0:1787574362.394685:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2351:x1874407272320640:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574362.394710:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272320768 00000100:00100000:1.0:1787574362.394716:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272320768 00000100:00100000:1.0:1787574362.394752:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272320384 00000100:00100000:1.0:1787574362.394756:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272320384 00000100:00100000:1.0:1787574362.394788:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 161 00000100:00100000:1.0:1787574362.394799:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f782322b-3b13-413b-a1b9-4500fa873ef8+6:2351:x1874407272320768:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574362.394807:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 162 00000100:00100000:0.0:1787574362.394820:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+20:2351:x1874407272320384:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574362.398498:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2351:x1874407272320512:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 3917us (4252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574362.398516:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00080000:2.0:1787574362.398590:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574362.401302:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2351:x1874407272320640:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 6605us (6946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574362.401321:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:1.0:1787574362.404716:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f782322b-3b13-413b-a1b9-4500fa873ef8+6:2351:x1874407272320768:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 9898us (10404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574362.404716:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+20:2351:x1874407272320384:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 9879us (10382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574362.404740:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 161 00000100:00100000:0.0:1787574362.404747:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 162 00000040:00080000:2.0:1787574362.417509:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787574362.417521:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787574362.417864:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1787574362.417872:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787574362.739137:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574362.739198:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290126464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574362.739310:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574362.740584:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290126464 00000100:00100000:0.0:1787574362.740604:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290126464 00000100:00100000:0.0:1787574362.740690:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787574362.740712:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290126464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574362.740766:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574362.741137:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290126464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 436us (1825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574362.741147:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787574362.741308:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290126464:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787574362.865848:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787574363.711801:0:12715:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:26:02 (1787574362) 00010000:00010000:0.0:1787574363.893147:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787574364.345977:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1787574364.346006:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1787574364.346326:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1787574364.346352:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1787574364.913828:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574365.938955:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574366.324965:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290126976:0@lo:400:kworker.0 00000100:00100000:3.0:1787574366.325077:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574366.325078:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290126720:0@lo:400:kworker.0 00000100:00100000:1.0:1787574366.325207:0:12475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290126976 00000100:00100000:1.0:1787574366.325218:0:12475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290126976 00000100:00100000:1.0:1787574366.325291:0:12475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787574366.325302:0:12475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290126976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574366.325410:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290126592:0@lo:400:kworker.0 00000100:00080000:3.0:1787574366.325520:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574366.325559:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874407290126848:0@lo:400:kworker.0 00000100:00100000:0.0:1787574366.331736:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574366.331824:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290127232:0@lo:400:kworker.0 00000100:00100000:0.0:1787574366.331868:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574366.331938:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290127232 00000100:00100000:0.0:1787574366.331946:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290127232 00000100:00100000:1.0:1787574366.332820:0:12475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290126976:12345-0@lo:400:kworker.0 Request processed in 7509us (7734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574366.332836:0:12475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1787574366.333031:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787574366.333063:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290126720 00000100:00100000:1.0:1787574366.333072:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290126720 00000100:00100000:1.0:1787574366.333223:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787574366.333298:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290126720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574366.333397:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290126720:12345-0@lo:400:kworker.0 Request processed in 102us (1668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574366.333406:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787574366.333426:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787574366.333446:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290127232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574366.333483:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290126720:0@lo:400:kworker.0 00000100:00100000:0.0:1787574366.333526:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290127232:12345-0@lo:400:kworker.0 Request processed in 88us (1655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574366.333537:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787574366.333542:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290127232:0@lo:400:kworker.0 00000100:00100000:1.0:1787574366.334201:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290126976:0@lo:400:kworker.0 00000100:00100000:2.0:1787574366.335556:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574366.335558:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574366.335643:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290126592 00000100:00100000:2.0:1787574366.335650:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874407290127104:0@lo:400:kworker.0 00000100:00100000:1.0:1787574366.335654:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290126592 00000100:00100000:1.0:1787574366.335720:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1787574366.335733:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:3301:x1874407290126592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574366.335818:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:3301:x1874407290126592:12345-0@lo:400:kworker.0 Request processed in 88us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574366.335826:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787574366.336211:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574366.342464:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290126592:0@lo:400:kworker.0 00000100:00100000:2.0:1787574366.345129:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290126848 00000100:00100000:0.0:1787574366.345146:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290127104 00000100:00100000:2.0:1787574366.345149:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290126848 00000100:00100000:0.0:1787574366.345209:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290127104 00000100:00100000:2.0:1787574366.345400:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787574366.345415:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874407290126848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574366.345525:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874407290126848:12345-0@lo:400:kworker.0 Request processed in 115us (9976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574366.345534:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787574366.345572:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787574366.345583:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874407290127104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574366.345677:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874407290127104:12345-0@lo:400:kworker.0 Request processed in 97us (9467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574366.345684:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787574366.346611:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874407290126848:0@lo:400:kworker.0 00000100:00100000:3.0:1787574366.349653:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874407290127104:0@lo:400:kworker.0 00000100:00080000:1.0:1787574366.351779:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574366.833709:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290127360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574366.833802:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574366.833971:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290127360 00000100:00100000:0.0:1787574366.833981:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290127360 00000100:00100000:0.0:1787574366.834039:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787574366.834049:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290127360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787574366.834218:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574366.834331:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290127360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 282us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574366.834355:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787574366.838058:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290127360:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787574366.965283:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574367.516453:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574367.516507:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574367.516590:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574367.516628:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574367.516652:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574367.516711:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272321408 00000100:00100000:0.0:1787574367.516713:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272320896 00000100:00100000:1.0:1787574367.516724:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272321408 00000100:00100000:0.0:1787574367.516724:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272320896 00000100:00100000:1.0:1787574367.516785:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272321024 00000100:00100000:0.0:1787574367.516789:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 301 00000100:00100000:1.0:1787574367.516791:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272321024 00000100:00100000:0.0:1787574367.516805:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+13:2352:x1874407272320896:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574367.516824:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 166 00000100:00100000:1.0:1787574367.516833:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f782322b-3b13-413b-a1b9-4500fa873ef8+6:2352:x1874407272321408:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574367.516908:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9891405-66e8-4ae2-851e-6434ae47d085+13:2352:x1874407272320896:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 98us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574367.516935:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 301 00000100:00100000:0.0:1787574367.516979:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 167 00000100:00100000:0.0:1787574367.516986:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:2352:x1874407272321024:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574367.519868:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f782322b-3b13-413b-a1b9-4500fa873ef8+6:2352:x1874407272321408:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 3019us (3260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574367.519883:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 166 00000100:00080000:1.0:1787574367.519958:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574367.522543:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:2352:x1874407272321024:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 5540us (5897us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574367.522562:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 167 00000100:00100000:3.0:1787574367.524386:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272321152 00000100:00100000:3.0:1787574367.524406:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272321152 00000100:00100000:3.0:1787574367.524499:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272321280 00000100:00100000:3.0:1787574367.524504:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272321280 00000100:00100000:3.0:1787574367.524578:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00100000:3.0:1787574367.524590:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2352:x1874407272321152:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574367.524683:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2352:x1874407272321152:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 95us (8174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574367.524694:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:1.0:1787574367.524712:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2352:x1874407272321280:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574367.524747:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2352:x1874407272321280:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 38us (8094us total) trans 0 rc 0/0 00000100:00080000:0.0:1787574367.524803:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574367.524809:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574367.526548:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00100000:1.0:1787574367.526614:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:1.0:1787574367.858345:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290127488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574367.858444:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574367.858648:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290127488 00000100:00100000:0.0:1787574367.858659:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290127488 00000100:00100000:0.0:1787574367.858731:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787574367.858742:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290127488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574367.858790:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574367.858852:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290127488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574367.858859:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787574367.858964:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290127488:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787574367.987475:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574368.067963:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574368.068096:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272321664 00000100:00100000:0.0:1787574368.068131:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272321664 00000100:00100000:0.0:1787574368.070489:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:0.0:1787574368.070520:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+19:12306:x1874407272321664:12345-192.168.206.51@tcp:35:umount.0 00000100:00100000:0.0:1787574368.073865:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+20:12306:x1874407272321664:12345-192.168.206.51@tcp:35:umount.0 Request processed in 3345us (5899us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1787574368.073884:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:0.0:1787574368.081561:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574368.081792:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272321920 00000100:00100000:3.0:1787574368.081805:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272321920 00000100:00100000:3.0:1787574368.081924:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:3.0:1787574368.081938:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+20:12306:x1874407272321920:12345-192.168.206.51@tcp:35:umount.0 00000100:00100000:3.0:1787574368.082667:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+21:12306:x1874407272321920:12345-192.168.206.51@tcp:35:umount.0 Request processed in 729us (1119us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787574368.082677:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:3.0:1787574368.091639:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574368.095701:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272322176 00000100:00100000:0.0:1787574368.095726:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272322176 00000100:00100000:0.0:1787574368.095819:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:0.0:1787574368.095833:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0327c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+21:12306:x1874407272322176:12345-192.168.206.51@tcp:35:umount.0 00000100:00100000:0.0:1787574368.096494:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0327c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+22:12306:x1874407272322176:12345-192.168.206.51@tcp:35:umount.0 Request processed in 660us (4931us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787574368.096504:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:2.0:1787574368.104244:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574368.104522:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272322432 00000100:00100000:0.0:1787574368.104538:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272322432 00000100:00100000:0.0:1787574368.104631:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:0.0:1787574368.104644:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+22:12306:x1874407272322432:12345-192.168.206.51@tcp:35:umount.0 00000100:00100000:0.0:1787574368.105155:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+23:12306:x1874407272322432:12345-192.168.206.51@tcp:35:umount.0 Request processed in 510us (922us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787574368.105195:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:2.0:1787574368.115000:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574368.115039:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574368.115070:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574368.115215:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272322560 00000100:00100000:1.0:1787574368.115229:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272322560 00000100:00100000:1.0:1787574368.115304:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272322816 00000100:00100000:1.0:1787574368.115307:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272322816 00000100:00100000:1.0:1787574368.115322:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272322688 00000100:00100000:1.0:1787574368.115324:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272322688 00000100:00100000:1.0:1787574368.115354:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1787574368.115368:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9891405-66e8-4ae2-851e-6434ae47d085+15:2353:x1874407272322560:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574368.115387:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574368.115414:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a027f3400/0xfe91058e646bf7de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea58 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574368.115438:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574368.115502:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9891405-66e8-4ae2-851e-6434ae47d085+14:2353:x1874407272322560:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 137us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574368.115512:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1787574368.115532:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:1.0:1787574368.115538:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9891405-66e8-4ae2-851e-6434ae47d085+13:2353:x1874407272322816:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574368.115546:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574368.115583:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a00031c00/0xfe91058e646bf9f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb23 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574368.115595:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574368.115613:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9891405-66e8-4ae2-851e-6434ae47d085+12:2353:x1874407272322816:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 75us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574368.115619:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:1.0:1787574368.115632:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:1.0:1787574368.115638:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9891405-66e8-4ae2-851e-6434ae47d085+11:2353:x1874407272322688:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574368.115645:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574368.115653:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a027f3800/0xfe91058e646bf744 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea20 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574368.115662:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574368.115675:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9891405-66e8-4ae2-851e-6434ae47d085+10:2353:x1874407272322688:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 37us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574368.115681:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:1.0:1787574368.117434:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574368.117556:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272322944 00000100:00100000:2.0:1787574368.117576:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272322944 00000100:00100000:2.0:1787574368.117633:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:2.0:1787574368.117644:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2349:x1874407272322944:12345-192.168.206.51@tcp:9:umount.0 00000020:00000080:2.0:1787574368.117677:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bfab6 00000100:00080000:2.0:1787574368.117709:0:6681:0:(import.c:65:import_set_state_nolock()) ffff982a41240800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787574368.117760:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1787574368.118094:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+2:2349:x1874407272322944:12345-192.168.206.51@tcp:9:umount.0 Request processed in 450us (667us total) trans 0 rc 0/0 00010000:00010000:1.0:1787574368.119249:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574368.119434:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:1.0:1787574368.131074:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574368.131240:0:12475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272323328 00000100:00100000:0.0:1787574368.131253:0:12475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272323328 00000100:00100000:0.0:1787574368.131322:0:12475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:0.0:1787574368.131333:0:12475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+7:2349:x1874407272323328:12345-192.168.206.51@tcp:9:umount.0 00000020:00000080:0.0:1787574368.131402:0:12475:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bfd17 00000020:00010000:0.0:1787574368.131412:0:12475:0:(genops.c:1921:obd_stale_export_put()) Put export ffff982a41244000: total 0 00000100:00080000:0.0:1787574368.131418:0:12475:0:(import.c:65:import_set_state_nolock()) ffff982a41247800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787574368.131466:0:12475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787574368.131790:0:12475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+5:2349:x1874407272323328:12345-192.168.206.51@tcp:9:umount.0 Request processed in 457us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574368.131800:0:12475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000020:00010000:1.0:1787574368.132657:0:5818:0:(genops.c:1907:obd_stale_export_get()) Get export ffff982a41244000: total 0 00010000:00010000:1.0:1787574368.132706:0:5818:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff982a41244000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787574368.132776:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd205865/0xfe91058e646c00ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecf8 expref: 4 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574368.132818:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055c3eb3e/0xfe91058e646c0758 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eec6 expref: 3 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574368.132852:0:5818:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff982a41244000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787574368.132865:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574368.132868:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574368.132870:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574368.152296:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574368.152607:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272324352 00000100:00100000:1.0:1787574368.152621:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272324352 00000100:00100000:1.0:1787574368.152701:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 240 00000100:00100000:1.0:1787574368.152713:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+23:2349:x1874407272324352:12345-192.168.206.51@tcp:39:umount.0 00000020:00000080:1.0:1787574368.152758:0:5832:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf752 00000020:00010000:1.0:1787574368.152778:0:5832:0:(genops.c:1921:obd_stale_export_put()) Put export ffff982a07897000: total 0 00000100:00080000:1.0:1787574368.152783:0:5832:0:(import.c:65:import_set_state_nolock()) ffff982a4192a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787574368.152819:0:5832:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1787574368.153287:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f+22:2349:x1874407272324352:12345-192.168.206.51@tcp:39:umount.0 Request processed in 572us (1001us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1787574368.153297:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 240 00000020:00010000:3.0:1787574368.154073:0:5819:0:(genops.c:1907:obd_stale_export_get()) Get export ffff982a07897000: total 0 00010000:00010000:3.0:1787574368.154089:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574368.154253:0:5819:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff982a07897000, canceled 0 locks, left on hash table 14. 00010000:00010000:3.0:1787574368.154295:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:3.0:1787574368.154299:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787574368.154308:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0600/0xfe91058e646c0743 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eebf expref: 21 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574368.154328:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff982a04dc0e00) 00010000:00010000:3.0:1787574368.154331:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574368.154335:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143600/0xfe91058e646bfa1c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb31 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574368.154478:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:3.0:1787574368.154481:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787574368.154485:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb800/0xfe91058e646c00a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecf1 expref: 19 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574368.154498:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:3.0:1787574368.154501:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787574368.154505:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143000/0xfe91058e646c0417 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eded expref: 18 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574368.154516:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:3.0:1787574368.154518:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787574368.154522:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a00031600/0xfe91058e646bfa8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb4d expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574368.154534:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:3.0:1787574368.154536:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574368.154540:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a16143a00/0xfe91058e646c0639 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ee79 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574368.154551:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:3.0:1787574368.154553:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574368.154556:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01e00/0xfe91058e646c0735 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eeb8 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574368.154681:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982a0de1df00) 00010000:00010000:3.0:1787574368.154684:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787574368.154694:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1400/0xfe91058e646bfd79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ec1f expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574368.154711:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982a03b34a00) 00010000:00010000:3.0:1787574368.154713:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787574368.154717:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa800/0xfe91058e646c0138 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed1b expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574368.154731:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:3.0:1787574368.154733:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574368.154737:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00a00/0xfe91058e646bff9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ecab expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574368.154749:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982a04da2c00) 00010000:00010000:3.0:1787574368.154751:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574368.154755:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1800/0xfe91058e646bfa38 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb38 expref: 11 pid: 7646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574368.154768:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982a0de1d100) 00010000:00010000:3.0:1787574368.154770:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574368.154773:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d01600/0xfe91058e646c007b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ece3 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574368.154785:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982a0de1d300) 00010000:00010000:3.0:1787574368.154787:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787574368.154791:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a41d00400/0xfe91058e646c070b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eeb1 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574368.154803:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34000) 00010000:00010000:3.0:1787574368.154809:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574368.154814:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fbc00/0xfe91058e646c011c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ed14 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574368.154824:0:5819:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff982a07897000, canceled 14 locks, left on hash table 0. 00010000:00010000:3.0:1787574368.154838:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574368.154840:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574368.154842:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787574368.908575:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f 00000020:00000080:3.0:1787574368.908589:0:7648:0:(genops.c:885:class_export_put()) final put ffff982a2e0db800/a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f 00000020:00000080:1.0:1787574368.908871:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff982a2e0db800/a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f for lustre-OST0001 00000020:00000080:1.0:1787574368.908942:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982a41240800 for lustre-OST0001 00010000:00010000:1.0:1787574369.009409:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787574369.430340:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f 00000020:00000080:3.0:1787574369.430353:0:6706:0:(genops.c:885:class_export_put()) final put ffff982a41244000/a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f 00000020:00000080:3.0:1787574369.430385:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982a41244000/a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f for lustre-OST0000 00000020:00000080:3.0:1787574369.430886:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982a41247800 for lustre-OST0000 00000001:00080000:0.0:1787574369.440403:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:0.0:1787574369.440424:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f 00000001:00080000:0.0:1787574369.440431:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1787574369.440437:0:5852:0:(genops.c:885:class_export_put()) final put ffff982a07897000/a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f 00000020:00000080:3.0:1787574369.442448:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff982a07897000/a7c6b42d-08b0-46c5-9653-5fd78ba6bc0f for lustre-MDT0000 00000020:00000080:3.0:1787574369.442527:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982a4192a800 for lustre-MDT0000 00010000:00010000:3.0:1787574370.033429:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574370.662682:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574370.662731:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574370.662853:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574370.662972:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272324480 00000100:00100000:0.0:1787574370.662986:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272324480 00000100:00100000:0.0:1787574370.663055:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272324608 00000100:00100000:0.0:1787574370.663058:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272324608 00000100:00100000:0.0:1787574370.663071:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272324736 00000100:00100000:0.0:1787574370.663073:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272324736 00000100:00100000:0.0:1787574370.663092:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:0.0:1787574370.663104:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9891405-66e8-4ae2-851e-6434ae47d085+12:2352:x1874407272324480:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574370.663123:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574370.663151:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a00030000/0xfe91058e646bf824 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea6d expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574370.663216:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574370.663294:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9891405-66e8-4ae2-851e-6434ae47d085+11:2352:x1874407272324480:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 191us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574370.663304:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:0.0:1787574370.663326:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:0.0:1787574370.663350:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9891405-66e8-4ae2-851e-6434ae47d085+10:2352:x1874407272324608:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574370.663359:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574370.663374:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a1d2ab200/0xfe91058e646bf82b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea97 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574370.663385:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574370.663405:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9891405-66e8-4ae2-851e-6434ae47d085+9:2352:x1874407272324608:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 57us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574370.663411:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:0.0:1787574370.663425:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:0.0:1787574370.663432:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a063aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9891405-66e8-4ae2-851e-6434ae47d085+8:2352:x1874407272324736:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574370.663439:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574370.663448:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a1d2aa400/0xfe91058e646bf9eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eb1c expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574370.663458:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574370.663476:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a063aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9891405-66e8-4ae2-851e-6434ae47d085+7:2352:x1874407272324736:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 45us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574370.663483:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:0.0:1787574370.672751:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574370.672866:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272324992 00000100:00100000:1.0:1787574370.672892:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272324992 00000100:00100000:1.0:1787574370.673001:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 241 00000100:00100000:1.0:1787574370.673015:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+6:2349:x1874407272324992:12345-192.168.206.51@tcp:39:umount.0 00000020:00000080:1.0:1787574370.673088:0:5831:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf839 00000020:00010000:1.0:1787574370.673098:0:5831:0:(genops.c:1921:obd_stale_export_put()) Put export ffff982a07894800: total 0 00000100:00080000:1.0:1787574370.673104:0:5831:0:(import.c:65:import_set_state_nolock()) ffff982a07897800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787574370.673144:0:5831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1787574370.673866:0:5818:0:(genops.c:1907:obd_stale_export_get()) Get export ffff982a07894800: total 0 00010000:00010000:3.0:1787574370.673938:0:5818:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff982a07894800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787574370.673982:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34000) 00010000:00010000:3.0:1787574370.673986:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574370.673997:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c0766 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eecd expref: 5 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574370.674024:0:5818:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff982a07894800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787574370.674036:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574370.674038:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574370.674040:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574370.674079:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f782322b-3b13-413b-a1b9-4500fa873ef8+3:2349:x1874407272324992:12345-192.168.206.51@tcp:39:umount.0 Request processed in 1065us (1344us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1787574370.674089:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 241 00000100:00080000:0.0:1787574370.674214:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574370.704548:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574370.704686:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272325248 00000100:00100000:1.0:1787574370.704699:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272325248 00000100:00100000:1.0:1787574370.704763:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 302 00000100:00100000:1.0:1787574370.704774:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+7:2349:x1874407272325248:12345-192.168.206.51@tcp:251:umount.0 00000020:00000080:1.0:1787574370.704853:0:5824:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf72f 00000020:00010000:1.0:1787574370.704862:0:5824:0:(genops.c:1921:obd_stale_export_put()) Put export ffff982906b8f800: total 0 00000100:00080000:1.0:1787574370.704867:0:5824:0:(import.c:65:import_set_state_nolock()) ffff982906b89800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787574370.704959:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9891405-66e8-4ae2-851e-6434ae47d085+3:2349:x1874407272325248:12345-192.168.206.51@tcp:251:umount.0 Request processed in 187us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574370.704968:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 302 00000020:00010000:3.0:1787574370.705393:0:5819:0:(genops.c:1907:obd_stale_export_get()) Get export ffff982906b8f800: total 0 00010000:00010000:3.0:1787574370.705411:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574370.705461:0:5819:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff982906b8f800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787574370.705500:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a027f3200/0xfe91058e646bf7e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ea5f expref: 2 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574370.705527:0:5819:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff982906b8f800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787574370.705535:0:5819:0:(genops.c:885:class_export_put()) final put ffff982906b8f800/c9891405-66e8-4ae2-851e-6434ae47d085 00010000:00010000:3.0:1787574370.705547:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574370.705549:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574370.705551:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787574370.706083:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982906b8f800/c9891405-66e8-4ae2-851e-6434ae47d085 for MGS 00000020:00000080:1.0:1787574370.706133:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982906b89800 for MGS 00010000:00010000:3.0:1787574371.057802:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574371.441429:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290128000:0@lo:400:kworker.0 00000100:00100000:1.0:1787574371.441527:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574371.441566:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290127616:0@lo:400:kworker.0 00000100:00100000:3.0:1787574371.441620:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574371.441624:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290127744:0@lo:400:kworker.0 00000100:00100000:3.0:1787574371.441662:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874407290128128:0@lo:400:kworker.0 00000100:00100000:1.0:1787574371.441669:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574371.441698:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290128256:0@lo:400:kworker.0 00000100:00100000:3.0:1787574371.441700:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574371.441744:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874407290127872:0@lo:400:kworker.0 00000100:00100000:1.0:1787574371.441751:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574371.441792:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574371.441793:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290128000 00000100:00100000:1.0:1787574371.441811:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290128000 00000100:00100000:3.0:1787574371.441845:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290127616 00000100:00100000:3.0:1787574371.441850:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290127616 00000100:00100000:1.0:1787574371.441895:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290128256 00000100:00100000:1.0:1787574371.441900:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290128256 00000100:00100000:3.0:1787574371.441911:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1787574371.441924:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:3301:x1874407290127616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574371.441935:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787574371.441945:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290128000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574371.441989:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7182851c-b624-4982-87cf-e891100b1765+19:3301:x1874407290127616:12345-0@lo:400:kworker.0 Request processed in 68us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574371.441998:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1787574371.442004:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290128000:12345-0@lo:400:kworker.0 Request processed in 59us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574371.442012:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787574371.442031:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787574371.442040:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290128256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574371.442041:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290127744 00000100:00100000:3.0:1787574371.442047:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290127744 00000100:00100000:3.0:1787574371.442080:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290128128 00000100:00100000:3.0:1787574371.442083:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290128128 00000100:00100000:1.0:1787574371.442087:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290128256:12345-0@lo:400:kworker.0 Request processed in 49us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574371.442097:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787574371.442115:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290127872 00000100:00100000:3.0:1787574371.442119:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290127872 00000100:00100000:1.0:1787574371.442126:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787574371.442136:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11be3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290127744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574371.442154:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787574371.442187:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874407290128128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574371.442201:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11be3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874407290127744:12345-0@lo:400:kworker.0 Request processed in 66us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574371.442208:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787574371.442227:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787574371.442231:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874407290128128:12345-0@lo:400:kworker.0 Request processed in 67us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574371.442238:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874407290127872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574371.442241:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787574371.442291:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874407290127872:12345-0@lo:400:kworker.0 Request processed in 55us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574371.442298:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787574371.442300:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290127616:0@lo:400:kworker.0 00000100:00100000:3.0:1787574371.442319:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874407290128128:0@lo:400:kworker.0 00000100:00100000:1.0:1787574371.442343:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874407290127744:0@lo:400:kworker.0 00000100:00100000:3.0:1787574371.442359:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874407290127872:0@lo:400:kworker.0 00000100:00100000:1.0:1787574371.442365:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290128256:0@lo:400:kworker.0 00000100:00100000:1.0:1787574371.442411:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290128000:0@lo:400:kworker.0 00000100:00080000:0.0:1787574371.442664:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787574371.442670:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574371.442673:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574371.954691:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574371.954988:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290128384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574371.955078:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574371.959315:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290128384 00000100:00100000:3.0:1787574371.959336:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290128384 00000100:00100000:3.0:1787574371.959417:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787574371.959433:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290128384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787574371.959490:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787574371.959598:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290128384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 169us (4519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574371.959605:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787574371.959725:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290128384:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787574372.082543:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787574372.618122:0:12920:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1787574372.629344:0:12920:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787574372.629406:0:12920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf7b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf7bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574372.629423:0:12920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf7b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf7bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574372.629432:0:12920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf7b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xfe91058e646bf7bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574372.629441:0:12920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf7b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xfe91058e646bf7bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574372.629464:0:12920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787574372.629471:0:12920:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787574372.629500:0:12920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787574372.629506:0:12920:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787574372.629513:0:12920:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787574372.629542:0:12920:0:(import.c:65:import_set_state_nolock()) ffff982a3a821800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787574372.629635:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574372.629643:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf7b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xfe91058e646bf7bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574372.629651:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030a00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1787574372.629655:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf7b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xfe91058e646bf7bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574372.629680:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf7b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xfe91058e646bf7bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574372.629689:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf7b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xfe91058e646bf7bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574372.629695:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787574372.629698:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787574372.629702:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787574372.629736:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf7b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xfe91058e646bf7bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574372.629745:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574372.629772:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf7b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xfe91058e646bf7bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574372.629781:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a00030a00/0xfe91058e646bf7b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xfe91058e646bf7bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574372.629796:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574372.629799:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574372.629802:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574372.629821:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874407290128512:0@lo:39:umount.0 00000100:00100000:3.0:1787574372.629919:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574372.630058:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574372.630073:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290128640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574372.630110:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574372.630206:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290128640 00000100:00100000:2.0:1787574372.630214:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290128640 00000100:00100000:2.0:1787574372.630276:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787574372.630288:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+19:3301:x1874407290128640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574372.630304:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574372.630323:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a42045000/0xfe91058e646bf7bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfe91058e646bf7b4 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574372.630340:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574372.630377:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7182851c-b624-4982-87cf-e891100b1765+18:3301:x1874407290128640:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574372.630385:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787574372.630426:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290128640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574372.630463:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290128512 00000100:00100000:2.0:1787574372.630467:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290128512 00000100:00100000:2.0:1787574372.630506:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787574372.630515:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874407290128512:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787574372.630541:0:7646:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf53e 00000100:00080000:2.0:1787574372.630552:0:7646:0:(import.c:65:import_set_state_nolock()) ffff982a4165c800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787574372.630617:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3297:x1874407290128512:12345-0@lo:39:umount.0 Request processed in 104us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574372.630625:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1787574372.630633:0:7646:0:(genops.c:885:class_export_put()) final put ffff982a4165f000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1787574372.630670:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787574372.630690:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982a4165f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787574372.630757:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982a4165c800 for lustre-MDT0000 00000100:00080000:3.0:1787574372.630846:0:3297:0:(import.c:65:import_set_state_nolock()) ffff982a3a821800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787574372.630856:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874407290128512:0@lo:39:umount.0 00000100:00080000:1.0:1787574372.630939:0:12920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787574372.630943:0:12920:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787574372.631011:0:12920:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787574372.632494:0:12920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab000/0xfe91058e646bf7c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf7c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574372.632514:0:12920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab000/0xfe91058e646bf7c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf7c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574372.632521:0:12920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab000/0xfe91058e646bf7c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xfe91058e646bf7c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574372.632529:0:12920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab000/0xfe91058e646bf7c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xfe91058e646bf7c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574372.632587:0:12920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787574372.632594:0:12920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa000/0xfe91058e646bf6e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf6f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574372.632602:0:12920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa000/0xfe91058e646bf6e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf6f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574372.632610:0:12920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa000/0xfe91058e646bf6e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfe91058e646bf6f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574372.632617:0:12920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa000/0xfe91058e646bf6e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfe91058e646bf6f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574372.632676:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787574372.632684:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab000/0xfe91058e646bf7c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xfe91058e646bf7c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574372.632705:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2ab000 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1787574372.632710:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab000/0xfe91058e646bf7c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xfe91058e646bf7c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574372.632719:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab000/0xfe91058e646bf7c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xfe91058e646bf7c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574372.632728:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab000/0xfe91058e646bf7c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xfe91058e646bf7c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574372.632735:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787574372.632738:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787574372.632775:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab000/0xfe91058e646bf7c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xfe91058e646bf7c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574372.632782:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574372.632815:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab000/0xfe91058e646bf7c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xfe91058e646bf7c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574372.632824:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a1d2ab000/0xfe91058e646bf7c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xfe91058e646bf7c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574372.632839:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574372.632843:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa000/0xfe91058e646bf6e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfe91058e646bf6f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574372.632849:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2aa000 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1787574372.632852:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa000/0xfe91058e646bf6e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfe91058e646bf6f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574372.632883:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa000/0xfe91058e646bf6e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xfe91058e646bf6f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574372.632891:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa000/0xfe91058e646bf6e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xfe91058e646bf6f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574372.632898:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787574372.632900:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1787574372.632916:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa000/0xfe91058e646bf6e9 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfe91058e646bf6f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574372.632923:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574372.632942:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa000/0xfe91058e646bf6e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfe91058e646bf6f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574372.632962:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574372.632964:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574372.632966:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574372.632974:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574372.632992:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290128768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574372.633060:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574372.633116:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290128896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574372.633145:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574372.633208:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290128768 00000100:00100000:3.0:1787574372.633215:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290128768 00000100:00100000:3.0:1787574372.633264:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290128896 00000100:00100000:3.0:1787574372.633267:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290128896 00000100:00100000:3.0:1787574372.633296:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787574372.633306:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7182851c-b624-4982-87cf-e891100b1765+19:3300:x1874407290128768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787574372.633330:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574372.633348:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a027f2800/0xfe91058e646bf7c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfe91058e646bf7c2 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574372.633363:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574372.633396:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7182851c-b624-4982-87cf-e891100b1765+18:3300:x1874407290128768:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574372.633403:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787574372.633423:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787574372.633431:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7182851c-b624-4982-87cf-e891100b1765+17:3298:x1874407290128896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787574372.633440:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574372.633450:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a1d2aa200/0xfe91058e646bf6f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfe91058e646bf6e9 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574372.633465:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574372.633497:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7182851c-b624-4982-87cf-e891100b1765+16:3298:x1874407290128896:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574372.633504:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787574372.633549:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7182851c-b624-4982-87cf-e891100b1765:3298:1874407290128896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574372.633578:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290128768:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787574372.633775:0:12920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787574372.633781:0:12920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a1d2aa000/0xfe91058e646bf6e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfe91058e646bf6f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574372.633801:0:12920:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787574372.633818:0:12920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf9dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf9e4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574372.633827:0:12920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf9dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf9e4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574372.633834:0:12920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf9dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xfe91058e646bf9e4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574372.633841:0:12920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf9dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xfe91058e646bf9e4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574372.633882:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574372.633889:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf9dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xfe91058e646bf9e4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574372.633896:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a42044200 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:2.0:1787574372.633899:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf9dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xfe91058e646bf9e4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574372.633906:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf9dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xfe91058e646bf9e4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574372.633914:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf9dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xfe91058e646bf9e4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574372.633920:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787574372.633922:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1787574372.633941:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf9dd lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xfe91058e646bf9e4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574372.634004:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787574372.634025:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf9dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xfe91058e646bf9e4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574372.634036:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574372.634044:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574372.634046:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574372.634085:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290129024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574372.634119:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787574372.634250:0:12920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787574372.634255:0:12920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a42044200/0xfe91058e646bf9dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xfe91058e646bf9e4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574372.634267:0:12920:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787574372.634276:0:12920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2aac00/0xfe91058e646bf49d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf4a4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574372.634284:0:12920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2aac00/0xfe91058e646bf49d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf4a4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574372.634292:0:12920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2aac00/0xfe91058e646bf49d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfe91058e646bf4a4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574372.634300:0:12920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff982a1d2aac00/0xfe91058e646bf49d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfe91058e646bf4a4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574372.634313:0:12920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787574372.634318:0:12920:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1787574372.634328:0:12920:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787574372.634361:0:12920:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787574372.634365:0:12920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787574372.634370:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574372.634377:0:12920:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1787574372.634383:0:12920:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff982a40fc2800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787574372.634389:0:12920:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff982a3a5c1000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787574372.634397:0:12920:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff982a07894800 f782322b-3b13-413b-a1b9-4500fa873ef8 192.168.206.51@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787574372.634403:0:12920:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff982a2bcab370) has exports, disconnecting them 00000020:00080000:1.0:1787574372.634407:0:12920:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff982a40fc2800), last request at 1787574371 00000020:00000080:1.0:1787574372.634415:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf6b1 00000100:00080000:1.0:1787574372.634433:0:12920:0:(import.c:65:import_set_state_nolock()) ffff982a40fc5800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787574372.634484:0:12920:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff982a40fc2800): rc 0 00000020:00000080:1.0:1787574372.634487:0:12920:0:(genops.c:885:class_export_put()) final put ffff982a40fc2800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787574372.634499:0:12920:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff982a3a5c1000), last request at 1787574371 00000020:00000080:1.0:1787574372.634503:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf5e6 00000100:00080000:1.0:1787574372.634509:0:12920:0:(import.c:65:import_set_state_nolock()) ffff982a3a5c5000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787574372.634515:0:12920:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff982a3a5c1000): rc 0 00000020:00000080:1.0:1787574372.634517:0:12920:0:(genops.c:885:class_export_put()) final put ffff982a3a5c1000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1787574372.634525:0:12920:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb5e241cebae0 00000100:00080000:1.0:1787574372.634546:0:12920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787574372.634551:0:12920:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1787574372.634566:0:12920:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787574372.634646:0:12920:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787574372.634661:0:12920:0:(import.c:65:import_set_state_nolock()) ffff982a0571f000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787574372.634673:0:12920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787574372.634675:0:12920:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1787574372.634685:0:12920:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787574372.634754:0:12920:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787574372.634763:0:12920:0:(import.c:65:import_set_state_nolock()) ffff982a0786f800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787574372.634797:0:12920:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff982a2bcab370) has no exports 00010000:00010000:3.0:1787574372.634854:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574372.634860:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a1d2aac00/0xfe91058e646bf49d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfe91058e646bf4a4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574372.634889:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2aac00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1787574372.634893:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2aac00/0xfe91058e646bf49d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfe91058e646bf4a4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574372.634902:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a1d2aac00/0xfe91058e646bf49d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xfe91058e646bf4a4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574372.634909:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2aac00/0xfe91058e646bf49d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xfe91058e646bf4a4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574372.634915:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787574372.634918:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787574372.634920:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787574372.634936:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a1d2aac00/0xfe91058e646bf49d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfe91058e646bf4a4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574372.634943:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574372.634974:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a1d2aac00/0xfe91058e646bf49d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfe91058e646bf4a4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574372.634982:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a1d2aac00/0xfe91058e646bf49d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfe91058e646bf4a4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574372.634999:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574372.635001:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574372.635003:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574372.635010:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574372.635022:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290129408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574372.635062:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1787574372.635218:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff982a40fc2800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787574372.635269:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff982a3a5c1000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787574372.635300:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982a40fc5800 for lustre-MDT0000 00000020:00000080:0.0:1787574372.635305:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982a3a5c5000 for lustre-MDT0000 00010000:00010000:0.0:1787574372.635314:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574372.635749:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874407290129152:0@lo:9:umount.0 00000100:00100000:3.0:1787574372.635788:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574372.635808:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874407290129280:0@lo:9:umount.0 00000100:00100000:3.0:1787574372.635829:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574372.635860:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290129152 00000100:00100000:3.0:1787574372.635866:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290129152 00000100:00100000:3.0:1787574372.635916:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290129280 00000100:00100000:3.0:1787574372.635919:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290129280 00000100:00100000:3.0:1787574372.635940:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787574372.636085:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1874407290129152:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787574372.636114:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf63a 00000100:00080000:3.0:1787574372.636122:0:6683:0:(import.c:65:import_set_state_nolock()) ffff982904f37800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787574372.636161:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1787574372.636516:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3297:x1874407290129152:12345-0@lo:9:umount.0 Request processed in 567us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574372.636524:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787574372.636540:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787574372.636547:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1874407290129280:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787574372.636560:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf721 00000100:00080000:3.0:1787574372.636565:0:6683:0:(import.c:65:import_set_state_nolock()) ffff982a4192e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787574372.636585:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787574372.636764:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3297:x1874407290129280:12345-0@lo:9:umount.0 Request processed in 216us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574372.636771:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:1.0:1787574372.636859:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574372.637245:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787574372.637278:0:3297:0:(import.c:65:import_set_state_nolock()) ffff982a0571f000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787574372.637291:0:3297:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787574372.637294:0:3297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787574372.637298:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874407290129152:0@lo:9:umount.0 00000100:00080000:1.0:1787574372.637309:0:3297:0:(import.c:65:import_set_state_nolock()) ffff982a0786f800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787574372.637317:0:3297:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787574372.637319:0:3297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787574372.637321:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874407290129280:0@lo:9:umount.0 00000100:00100000:2.0:1787574372.637441:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290129024 00000100:00100000:2.0:1787574372.637447:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290129024 00000100:00100000:2.0:1787574372.637525:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290129408 00000100:00100000:2.0:1787574372.637529:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290129408 00000100:00100000:0.0:1787574372.637566:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787574372.637575:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+17:3299:x1874407290129024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787574372.637588:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574372.637609:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a057e1600/0xfe91058e646bf9e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfe91058e646bf9dd expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574372.637626:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574372.637668:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+16:3299:x1874407290129024:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (3550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574372.637676:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787574372.637690:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787574372.637696:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+15:3301:x1874407290129408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787574372.637703:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574372.637712:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a027f2200/0xfe91058e646bf4a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfe91058e646bf49d expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574372.637726:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574372.637750:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7182851c-b624-4982-87cf-e891100b1765+14:3301:x1874407290129408:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (2688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574372.637757:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787574372.638023:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7182851c-b624-4982-87cf-e891100b1765:3299:1874407290129024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574372.638054:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7182851c-b624-4982-87cf-e891100b1765:3301:1874407290129408:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1787574372.646067:0:12920:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff982a2bcab370) has no exports 00000020:00000080:1.0:1787574372.712104:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf4f8 00000020:00000080:1.0:1787574372.712121:0:12920:0:(genops.c:885:class_export_put()) final put ffff982a246ad800/lustre-QMT0000_UUID 00000020:01000000:1.0:1787574372.712232:0:12920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787574372.712346:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787574372.712356:0:12920:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787574372.712362:0:12920:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff982a04888000) has no exports 00000020:00000080:2.0:1787574372.712547:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982a246ad800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787574372.712802:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf4f1 00000020:00000080:1.0:1787574372.712811:0:12920:0:(genops.c:885:class_export_put()) final put ffff982a3d02c800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787574372.712897:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787574372.712904:0:12920:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787574372.712907:0:12920:0:(genops.c:885:class_export_put()) final put ffff982a034d4000/lustre-QMT0000_UUID 00000020:00000080:1.0:1787574372.712909:0:12920:0:(genops.c:844:class_export_destroy()) destroying export ffff982a034d4000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787574372.712917:0:12920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1787574372.713444:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982a3d02c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1787574373.105577:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787574374.043850:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787574374.043871:0:7648:0:(genops.c:885:class_export_put()) final put ffff982a41928000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787574374.043991:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982a41928000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787574374.044126:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982a4192e800 for lustre-OST0001 00010000:00010000:1.0:1787574374.129401:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787574374.546015:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f782322b-3b13-413b-a1b9-4500fa873ef8 00000001:00080000:0.0:1787574374.546113:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1787574374.546120:0:5852:0:(genops.c:885:class_export_put()) final put ffff982a07894800/f782322b-3b13-413b-a1b9-4500fa873ef8 00000020:00000080:2.0:1787574374.546184:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982a07894800/f782322b-3b13-413b-a1b9-4500fa873ef8 for lustre-MDT0000 00000020:00000080:2.0:1787574374.546240:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982a07897800 for lustre-MDT0000 00000001:00100000:2.0:1787574374.549307:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787574374.549315:0:6706:0:(genops.c:885:class_export_put()) final put ffff982904f30800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787574374.549389:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff982904f30800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787574374.549435:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982904f37800 for lustre-OST0000 00000020:01000000:1.0:1787574374.769372:0:12920:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff982a3ad573c0 - data ffff982a3fe70a20/ffff9829047d4800 00000020:01000000:1.0:1787574374.769516:0:12920:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff982a0699f540 - data ffff982a2b87a438/ffff982a04f4ec00 00000001:00000004:1.0:1787574374.784455:0:12920:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1787574374.897372:0:12920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787574374.897381:0:12920:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1787574374.897409:0:12920:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787574374.897412:0:12920:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787574374.897886:0:7038:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787574374.897891:0:7038:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1787574374.897903:0:7038:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787574374.902372:0:12920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787574374.902380:0:12920:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1787574374.902408:0:12920:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787574374.902411:0:12920:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787574374.902714:0:8031:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787574374.902720:0:8031:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1787574374.902731:0:8031:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787574374.980128:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf4c0 00000020:00000080:3.0:1787574374.980140:0:12920:0:(genops.c:885:class_export_put()) final put ffff982a40fc0000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787574374.980656:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982a40fc0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787574374.981104:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf4d5 00000020:00000080:3.0:1787574374.981111:0:12920:0:(genops.c:885:class_export_put()) final put ffff982a40f8d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787574374.981154:0:12920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787574374.981160:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787574374.981184:0:12920:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787574374.981189:0:12920:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff982a2bcacd28) has no exports 00000004:01000000:3.0:1787574374.981333:0:12920:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787574374.981341:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf713 00000020:00000080:3.0:1787574374.981345:0:12920:0:(genops.c:885:class_export_put()) final put ffff982a0786e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787574374.981720:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982a40f8d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787574374.982116:0:12920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787574374.982123:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787574374.982131:0:12920:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787574374.982134:0:12920:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff982904c7cd28) has no exports 00000020:00000080:3.0:1787574374.982140:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf70c 00000020:00000080:3.0:1787574374.982145:0:12920:0:(genops.c:885:class_export_put()) final put ffff982a07869000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787574374.982181:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982a0786e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1787574374.982590:0:12920:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787574374.982594:0:12920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787574374.982598:0:12920:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1787574374.982603:0:12920:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787574374.982605:0:12920:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787574374.982739:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982a07869000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787574374.982822:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787574374.982830:0:12920:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787574374.982837:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf62c 00000020:00000080:3.0:1787574374.982842:0:12920:0:(genops.c:885:class_export_put()) final put ffff982904f33000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787574374.982872:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982a0786f800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787574374.982877:0:467:0:(genops.c:885:class_export_put()) final put ffff982904edc800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787574374.982879:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982904edc800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787574374.983067:0:12920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787574374.983073:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787574374.983077:0:12920:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787574374.983089:0:12920:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff982a03e90000) has no exports 00000020:00000080:3.0:1787574374.983094:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf625 00000020:00000080:3.0:1787574374.983097:0:12920:0:(genops.c:885:class_export_put()) final put ffff982a0571e800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787574374.983336:0:467:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787574374.983403:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982904f33000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787574374.983408:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982a0571e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787574374.983717:0:12920:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787574374.983721:0:12920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787574374.983724:0:12920:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1787574374.983727:0:12920:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787574374.983729:0:12920:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787574374.983795:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787574374.983801:0:12920:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787574374.983828:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787574374.983831:0:12920:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787574374.983835:0:12920:0:(genops.c:885:class_export_put()) final put ffff982a40fc1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787574374.983837:0:12920:0:(genops.c:844:class_export_destroy()) destroying export ffff982a40fc1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787574374.983841:0:12920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787574374.983986:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf4dc 00000020:00000080:3.0:1787574374.983991:0:12920:0:(genops.c:885:class_export_put()) final put ffff982a40f8a800/lustre-MDD0000_UUID 00000020:00000080:2.0:1787574374.984097:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982a0571f000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787574374.984103:0:467:0:(genops.c:885:class_export_put()) final put ffff982904c61000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787574374.984105:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982904c61000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787574374.984112:0:467:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787574374.984263:0:12920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1787574374.984268:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787574374.984272:0:12920:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787574374.984276:0:12920:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff982a2bca8000) has no exports 00000020:00000080:3.0:1787574374.984296:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787574374.984299:0:12920:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1787574374.984303:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf4e3 00000020:00000080:3.0:1787574374.984306:0:12920:0:(genops.c:885:class_export_put()) final put ffff982a40f88800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787574374.984329:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982a40f8a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787574374.984333:0:467:0:(genops.c:885:class_export_put()) final put ffff982a40fc6000/lustre-MDD0000_UUID 00000020:00000080:2.0:1787574374.984334:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982a40fc6000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787574374.984337:0:467:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1787574374.984513:0:12920:0:(tgt_mount.c:187:server_put_mount()) put mount ffff982a0622a800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1787574374.984516:0:12920:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982a0622a800 3 00000020:01000004:3.0:1787574374.984519:0:12920:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff982a0622a800 from lustre-MDT0000 00000020:00000080:3.0:1787574374.984545:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787574374.984549:0:12920:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1787574374.984551:0:12920:0:(genops.c:885:class_export_put()) final put ffff982a40fc3800/lustre-MDT0000_UUID 00000020:00000080:3.0:1787574374.984554:0:12920:0:(genops.c:844:class_export_destroy()) destroying export ffff982a40fc3800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1787574374.984572:0:12920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1787574374.984595:0:12920:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1787574374.984599:0:12920:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1787574374.984601:0:12920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1787574374.984603:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787574374.984605:0:12920:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787574374.984611:0:12920:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff982a03512800 7182851c-b624-4982-87cf-e891100b1765 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787574374.984616:0:12920:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff982a0488cd28) has exports, disconnecting them 00000020:00080000:3.0:1787574374.984620:0:12920:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff982a03512800), last request at 1787574156 00000020:00000080:3.0:1787574374.984632:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf481 00000020:00010000:3.0:1787574374.984636:0:12920:0:(genops.c:1921:obd_stale_export_put()) Put export ffff982a03512800: total 1 00000100:00080000:3.0:1787574374.984639:0:12920:0:(import.c:65:import_set_state_nolock()) ffff982a03510800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787574374.984659:0:12920:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff982a03512800): rc 0 00000020:00080000:3.0:1787574374.984662:0:12920:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff982a0488cd28) has no exports 00000020:00010000:0.0:1787574374.984700:0:5818:0:(genops.c:1907:obd_stale_export_get()) Get export ffff982a03512800: total 1 00010000:00010000:0.0:1787574374.984729:0:5818:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff982a03512800, canceled 0 locks, left on hash table 8. 00000100:00100000:3.0:1787574374.984753:0:5823:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff982a04f2d600:5823] 0 exiting: rc = 1 00010000:00010000:0.0:1787574374.984831:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a027f2400/0xfe91058e646bf599 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfe91058e646bf592 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574374.984835:0:5824:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff982a04f2da00:5824] 1 exiting: rc = 0 00010000:00010000:0.0:1787574374.984851:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a027f3600/0xfe91058e646bf7d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfe91058e646bf7d0 expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574374.984876:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a00030800/0xfe91058e646bf783 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfe91058e646bf77c expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574374.984898:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a42044600/0xfe91058e646bf791 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfe91058e646bf78a expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574374.984908:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a42045200/0xfe91058e646bf79f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfe91058e646bf798 expref: 5 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574374.984917:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a00031e00/0xfe91058e646bf7ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfe91058e646bf7a6 expref: 4 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574374.984944:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a057e1a00/0xfe91058e646bf9c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfe91058e646bf9c1 expref: 3 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574374.984954:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a42044a00/0xfe91058e646bf9d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfe91058e646bf9cf expref: 2 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574374.984965:0:5818:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff982a03512800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1787574374.984981:0:5818:0:(genops.c:885:class_export_put()) final put ffff982a03512800/7182851c-b624-4982-87cf-e891100b1765 00000020:00000080:2.0:1787574374.985107:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982a40f88800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1787574374.985121:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574374.985124:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574374.985126:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574374.985150:0:5825:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff982a04f2de00:5825] 2 exiting: rc = 0 00000020:00000080:2.0:1787574374.985152:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982a03512800/7182851c-b624-4982-87cf-e891100b1765 for MGS 00000020:00000080:2.0:1787574374.985187:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982a03510800 for MGS 00000100:00100000:0.0:1787574374.985233:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985240:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985249:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985260:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985265:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985271:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985277:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985282:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985289:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985294:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985300:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985305:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985310:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985315:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985320:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985325:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985329:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985335:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985340:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985352:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985357:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985362:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985367:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985372:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985378:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985383:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985388:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985393:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985398:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985409:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985414:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985419:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985424:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985428:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985439:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985446:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985452:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985456:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985462:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985468:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985473:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985479:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985485:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985491:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985496:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985501:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985505:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985510:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985515:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985520:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985525:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985531:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985536:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985541:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985554:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985560:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985566:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985572:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985577:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985582:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985588:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985594:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985599:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574374.985605:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1787574374.986102:0:12920:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787574374.986105:0:12920:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1787574374.988944:0:12920:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff982a3a8177e0 - data ffff982a3fecc5e8/ffff982a41984400 00000020:01000000:0.0:1787574374.989150:0:12920:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff982a113499c0 - data ffff982a2d3adbd0/ffff982a03485000 00000020:00000080:0.0:1787574374.990148:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf465 00000020:00000080:0.0:1787574374.990161:0:12920:0:(genops.c:885:class_export_put()) final put ffff982a07e8f000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787574374.990202:0:12920:0:(tgt_mount.c:187:server_put_mount()) put mount ffff982a0622a800 from MGS, refs=2 00000020:01000004:0.0:1787574374.990206:0:12920:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982a0622a800 2 00000020:01000004:0.0:1787574374.990209:0:12920:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff982a0622a800 from MGS 00000020:00000080:3.0:1787574374.990257:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff982a07e8f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787574374.990853:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787574374.990874:0:12920:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787574374.990878:0:12920:0:(genops.c:885:class_export_put()) final put ffff982a2e03e000/MGS 00000020:00000080:0.0:1787574374.990881:0:12920:0:(genops.c:844:class_export_destroy()) destroying export ffff982a2e03e000/MGS for MGS 00000020:01000000:0.0:1787574374.991800:0:12920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787574374.991880:0:12920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787574374.991885:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787574374.992289:0:12920:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787574374.992297:0:12920:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff982a0340c800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787574374.992303:0:12920:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff982a03e94d28) has exports, disconnecting them 00000020:00080000:0.0:1787574374.992308:0:12920:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff982a0340c800), last request at 1787574156 00000020:00000080:0.0:1787574374.992312:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf530 00000020:00080000:0.0:1787574374.992326:0:12920:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff982a0340c800): rc 0 00000020:00000080:0.0:1787574374.992338:0:12920:0:(genops.c:885:class_export_put()) final put ffff982a0340c800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787574374.992558:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff982a0340c800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787574374.996259:0:12920:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787574374.996268:0:12920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787574374.996272:0:12920:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787574374.996278:0:12920:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787574374.996421:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982a3a821800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787574374.996534:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787574374.996544:0:12920:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787574374.996549:0:12920:0:(genops.c:885:class_export_put()) final put ffff982a3a820000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787574374.996552:0:12920:0:(genops.c:844:class_export_destroy()) destroying export ffff982a3a820000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787574374.996840:0:12920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787574374.996903:0:12920:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982a0622a800 1 00000020:00000080:2.0:1787574374.996911:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf457 00000020:00000080:2.0:1787574374.996917:0:12920:0:(genops.c:885:class_export_put()) final put ffff982a2e038000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787574374.996934:0:12920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787574374.996939:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787574374.996944:0:12920:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787574374.996948:0:12920:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff982a2bca99b8) has no exports 00000020:00000080:3.0:1787574374.996959:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff982a2e038000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787574375.017002:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787574375.017019:0:12920:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787574375.017037:0:12920:0:(genops.c:885:class_export_put()) final put ffff982a0622c000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787574375.017042:0:12920:0:(genops.c:844:class_export_destroy()) destroying export ffff982a0622c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787574375.017056:0:12920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787574375.017183:0:12920:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff982a0622e000 00000020:01000000:2.0:1787574375.017203:0:12920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787574375.017207:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787574375.017211:0:12920:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787574375.017215:0:12920:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff982a03560000) has no exports 00000100:00100000:2.0:1787574375.017293:0:7646:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff982a3a6e9400:7646] 3 exiting: rc = 0 00000100:00100000:2.0:1787574375.017391:0:5830:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff982a0356c000:5830] 0 exiting: rc = 1 00000100:00100000:3.0:1787574375.018264:0:5831:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff982a0358dc00:5831] 1 exiting: rc = 0 00000100:00100000:1.0:1787574375.018413:0:5832:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff982a0356de00:5832] 2 exiting: rc = 0 00000100:00100000:2.0:1787574375.018805:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.018812:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.018818:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.018828:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.018833:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.018838:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.018846:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.018852:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.018868:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.018874:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.018879:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.018885:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019038:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019043:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019048:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019053:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019058:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019063:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019067:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019072:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019077:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019081:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019086:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019090:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019102:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019106:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019111:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019116:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019121:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019126:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019131:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019135:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019140:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019144:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019149:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019153:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019530:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019536:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019542:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019547:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019551:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019566:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019572:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019578:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019584:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019591:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019597:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019607:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019612:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019667:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019674:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019680:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019685:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019690:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019695:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019701:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019706:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019711:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019716:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019727:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019732:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019737:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019742:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.019750:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.028694:0:5834:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff982a03264800:5834] 1 exiting: rc = 0 00000100:00100000:3.0:1787574375.030298:0:5833:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff982a0356ce00:5833] 0 exiting: rc = 1 00000100:00100000:3.0:1787574375.030472:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030481:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030488:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030493:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030499:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030505:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030512:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030643:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030649:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030655:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030661:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030667:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030672:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030677:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030682:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030686:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030691:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030695:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030700:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030705:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030710:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030716:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030721:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030725:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030730:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030734:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030739:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030743:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030749:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030764:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030769:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030774:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030779:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030785:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030790:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030795:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030801:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030806:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030811:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030817:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030822:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030827:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030839:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030844:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030848:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030853:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030868:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.030875:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.031011:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.031019:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.031025:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.031030:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.031035:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.031039:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.031044:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.031049:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.031053:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.031058:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.031063:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.031067:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.031072:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.031077:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.031082:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.031086:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574375.031872:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff982a03264200:5835] 0 exiting: rc = 1 00000100:00100000:2.0:1787574375.031883:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff982a035a1000:5836] 1 exiting: rc = 0 00000100:00100000:3.0:1787574375.031979:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.031987:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.031993:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.031999:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032004:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032010:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032023:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032029:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032036:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032042:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032048:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032053:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032058:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032071:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032077:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032082:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032088:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032093:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032113:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032119:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032124:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032129:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032134:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032139:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032144:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032150:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032156:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032161:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032195:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032202:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032222:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032229:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032236:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032241:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032247:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032253:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032258:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032264:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032270:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032276:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032282:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032287:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032319:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032327:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032332:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032338:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032343:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032348:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032360:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032366:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032371:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032378:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032383:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032388:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032408:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032415:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032420:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032425:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032432:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032438:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032444:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032451:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032457:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.032463:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.046233:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff982a035a0a00:5837] 0 exiting: rc = 1 00000100:00100000:3.0:1787574375.057075:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff982a035a0600:5838] 1 exiting: rc = 0 00000100:00100000:2.0:1787574375.057296:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057303:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057309:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057314:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057320:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057325:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057330:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057334:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057339:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057344:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057349:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057354:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057358:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057362:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057367:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057371:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057376:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057381:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057390:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057396:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057430:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057438:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057443:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057449:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057455:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057460:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057465:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057471:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057488:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057494:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057501:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057506:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057512:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057518:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057604:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057614:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057619:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057624:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057629:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057634:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057640:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057645:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057651:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057657:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057662:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057667:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057673:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057678:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057684:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057690:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057696:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057703:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057708:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057714:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057721:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057727:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057733:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057739:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057745:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057825:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057833:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057839:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057845:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.057872:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.058386:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff982a0359d800:5840] 1 exiting: rc = 0 00000100:00100000:3.0:1787574375.058469:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff982a0359c600:5839] 0 exiting: rc = 1 00000100:00100000:2.0:1787574375.058620:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058627:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058632:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058638:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058644:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058650:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058656:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058662:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058668:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058674:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058680:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058685:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058691:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058696:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058702:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058708:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058713:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058719:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058725:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058732:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058737:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058743:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058749:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058835:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058841:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058847:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058853:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058870:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058877:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058953:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058959:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058965:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058971:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058976:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058991:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.058996:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059002:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059008:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059013:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059019:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059024:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059029:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059034:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059039:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059044:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059050:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059055:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059061:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059067:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059072:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059078:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059083:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059089:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059095:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059101:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059107:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059113:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059118:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059124:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059130:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059136:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059142:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059149:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059154:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.059625:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff982a035a0c00:5842] 1 exiting: rc = 0 00000100:00100000:3.0:1787574375.059836:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff982a035a0400:5841] 0 exiting: rc = 1 00000100:00100000:2.0:1787574375.060030:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060038:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060044:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060050:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060067:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060073:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060080:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060086:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060092:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060098:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060105:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060111:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060117:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060123:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060130:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060136:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060142:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060148:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060153:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060159:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060243:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060251:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060256:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060261:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060267:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060272:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060277:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060282:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060287:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060293:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060298:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060303:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060309:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060313:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060319:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060324:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060330:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060336:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060342:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060357:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060364:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060370:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060375:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060380:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060385:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060389:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060394:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060399:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060404:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060409:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060413:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060418:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060423:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060428:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060433:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060438:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060443:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060447:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060453:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060458:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060464:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060469:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060475:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.060481:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574375.061872:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff982a03554600:5843] 0 exiting: rc = 1 00000100:00100000:1.0:1787574375.062283:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff982a03555800:5844] 1 exiting: rc = 0 00000100:00100000:1.0:1787574375.062433:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff982a03554e00:5845] 2 exiting: rc = 0 00000100:00100000:3.0:1787574375.062662:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.062671:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.062677:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.062700:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.062708:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.062713:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.062719:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.062725:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.062730:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.062737:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.062743:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.062828:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.062838:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.062843:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.062871:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.062877:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.062957:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.062963:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.062969:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.062976:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.062982:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.062987:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.062994:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063000:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063006:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063012:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063018:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063039:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063048:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063054:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063060:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063066:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063072:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063077:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063083:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063089:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063095:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063101:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063108:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063113:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063119:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063125:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063130:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063135:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063141:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063147:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063153:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063159:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063193:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063207:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063212:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063232:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063240:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063245:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063252:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063258:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063264:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063270:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063276:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063283:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063289:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063295:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063301:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574375.063314:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787574375.069107:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787574375.069121:0:12920:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787574375.069127:0:12920:0:(genops.c:885:class_export_put()) final put ffff982a04934800/MDS_uuid 00000020:00000080:3.0:1787574375.069131:0:12920:0:(genops.c:844:class_export_destroy()) destroying export ffff982a04934800/MDS_uuid for MDS 00000020:01000000:3.0:1787574375.069138:0:12920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787574375.069379:0:12920:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787574375.155532:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574376.179355:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574376.561503:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574376.561534:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290129536:0@lo:400:kworker.0 00000100:00100000:1.0:1787574376.561555:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290129664:0@lo:400:kworker.0 00000400:00000100:0.0:1787574376.561597:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874407290129536 offset 0 length 224: 4 00000400:00000100:1.0:1787574376.561620:0:3298:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407290129664 offset 0 length 224: 4 00000100:00100000:1.0:1787574376.570496:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574376.570520:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290129792:0@lo:400:kworker.0 00000400:00000100:1.0:1787574376.570582:0:3298:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407290129792 offset 0 length 224: 4 00010000:00010000:0.0:1787574377.201446:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787574377.377339:0:13072:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1787574377.400727:0:13072:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787574377.400785:0:13072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf798 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf79f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574377.400803:0:13072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf798 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf79f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574377.400811:0:13072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf798 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xfe91058e646bf79f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574377.400819:0:13072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xfe91058e646bf79f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574377.400913:0:13072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787574377.400920:0:13072:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787574377.400961:0:13072:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787574377.400975:0:13072:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff982a419a2d80 x1874407290129664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574392 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574377.401011:0:13072:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787574377.401026:0:13072:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787574377.401089:0:13072:0:(import.c:65:import_set_state_nolock()) ffff982904f35800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787574377.401136:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1874407290129920:0@lo:39:umount.0 00000400:00000100:1.0:1787574377.401273:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407290129920 offset 0 length 224: 4 00000100:00100000:2.0:1787574377.401554:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290129664:0@lo:400:kworker.0 00010000:00010000:0.0:1787574377.401634:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574377.401661:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xfe91058e646bf79f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574377.401672:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2abe00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:0.0:1787574377.401676:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xfe91058e646bf79f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574377.401688:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xfe91058e646bf79f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574377.401696:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xfe91058e646bf79f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574377.401703:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787574377.401705:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787574377.401708:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787574377.401753:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf798 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xfe91058e646bf79f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574377.401760:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787574377.401818:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290130048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574377.401887:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574377.401981:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290130048 00000100:00100000:3.0:1787574377.401991:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290130048 00000100:00100000:3.0:1787574377.402057:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787574377.402067:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3300:x1874407290130048:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787574377.402082:0:5816:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787574377 with bad export cookie 18343448866385032321 00010000:00010000:0.0:1787574377.404466:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf798 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xfe91058e646bf79f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574377.404510:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a1d2abe00/0xfe91058e646bf798 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xfe91058e646bf79f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574377.404534:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574377.404537:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574377.404539:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574377.415345:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3300:x1874407290130048:12345-0@lo:103:ldlm_bl.0 Request processed in 13265us (13445us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787574377.415364:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1787574377.415703:0:3300:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787574377.415710:0:3300:0:(import.c:65:import_set_state_nolock()) ffff982a034d2000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787574377.415714:0:3300:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.151@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1787574377.430211:0:3300:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.151@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787574377.430217:0:3300:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787574377.430227:0:3300:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff982a419a1880 x1874407290129536/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787574392 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574377.430242:0:3300:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff982a3adf1880 x1874407290130048/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787574393 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787574377.430251:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787574377.430253:0:3300:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787574377.430255:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787574377.430259:0:3300:0:(import.c:65:import_set_state_nolock()) ffff982a034d2000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787574377.430263:0:3300:0:(import.c:510:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 132 00000100:00080000:1.0:1787574377.430272:0:3300:0:(import.c:624:import_select_connection()) MGC192.168.206.151@tcp: import ffff982a034d2000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1787574377.430561:0:3300:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982a40fe1500 x1874407290130176/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787574377.430624:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290129536:0@lo:400:kworker.0 00000100:00100000:2.0:1787574377.430656:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7182851c-b624-4982-87cf-e891100b1765:3300:1874407290130048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574377.430742:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7182851c-b624-4982-87cf-e891100b1765:3297:1874407290130176:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1787574377.433856:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874407290130176 offset 0 length 520: 4 00010000:00010000:0.0:1787574378.229620:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574379.251881:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574380.274349:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574381.298857:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787574381.681518:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7182851c-b624-4982-87cf-e891100b1765->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787574381.681532:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7182851c-b624-4982-87cf-e891100b1765->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787574381.681644:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574381.681836:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874407290130304:0@lo:400:kworker.0 00000400:00000100:3.0:1787574381.682048:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407290130304 offset 0 length 224: 4 00010000:00010000:0.0:1787574382.326654:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787574382.705298:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7182851c-b624-4982-87cf-e891100b1765->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787574382.705312:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7182851c-b624-4982-87cf-e891100b1765->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787574382.705398:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787574382.705418:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874407290130432:0@lo:400:kworker.0 00000400:00000100:1.0:1787574382.705502:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407290130432 offset 0 length 224: 4 00010000:00010000:0.0:1787574383.345853:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574384.369539:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574385.393538:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574386.417599:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574387.444105:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574387.826136:0:3297:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574377/real 1787574377] req@ffff982a40fe1500 x1874407290130176/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787574387 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574387.826202:0:3297:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff982a40fe1500 x1874407290130176/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787574387 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574387.826215:0:3297:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574377/real 1787574377] req@ffff982a419a2680 x1874407290129920/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787574387 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574387.826228:0:3297:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff982a419a2680 x1874407290129920/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787574387 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787574387.826245:0:3297:0:(import.c:65:import_set_state_nolock()) ffff982a034d2000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787574387.826327:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1787574387.826333:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7182851c-b624-4982-87cf-e891100b1765:3297:1874407290130176:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1787574387.826340:0:3297:0:(import.c:65:import_set_state_nolock()) ffff982904f35800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787574387.826358:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1874407290129920:0@lo:39:umount.0 00000100:00080000:0.0:1787574387.826417:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7182851c-b624-4982-87cf-e891100b1765->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787574387.826422:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787574387.826426:0:467:0:(import.c:65:import_set_state_nolock()) ffff982a034d2000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787574387.826432:0:467:0:(import.c:510:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 353 00000100:00080000:0.0:1787574387.826438:0:467:0:(import.c:589:import_select_connection()) MGC192.168.206.151@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787574387.826446:0:467:0:(import.c:624:import_select_connection()) MGC192.168.206.151@tcp: import ffff982a034d2000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1787574387.826486:0:467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982a3adf0a80 x1874407290130560/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574387.826543:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7182851c-b624-4982-87cf-e891100b1765:3297:1874407290130560:0@lo:250:kworker.0 00000400:00000100:3.0:1787574387.826598:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874407290130560 offset 0 length 520: 4 00000100:00100000:0.0:1787574387.826712:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574387.826736:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290130688:0@lo:400:kworker.0 00000400:00000100:0.0:1787574387.826764:0:3298:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407290130688 offset 0 length 224: 4 00000100:00080000:1.0:1787574387.829009:0:13072:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787574387.829045:0:13072:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787574387.829054:0:13072:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787574387.830063:0:13072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf7a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf7ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574387.830084:0:13072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf7a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf7ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574387.830092:0:13072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf7a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xfe91058e646bf7ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574387.830100:0:13072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf7a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xfe91058e646bf7ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574387.830120:0:13072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787574387.830129:0:13072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42045e00/0xfe91058e646bf9cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf9d6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574387.830136:0:13072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42045e00/0xfe91058e646bf9cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf9d6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574387.830143:0:13072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42045e00/0xfe91058e646bf9cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfe91058e646bf9d6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574387.830149:0:13072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff982a42045e00/0xfe91058e646bf9cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfe91058e646bf9d6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574387.830206:0:13072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787574387.830211:0:13072:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787574387.830235:0:13072:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787574387.830239:0:13072:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787574387.830254:0:13072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574387.830261:0:13072:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787574387.830267:0:13072:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff982904c78000) has no exports 00000020:00080000:1.0:1787574387.830300:0:13072:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff982904c78000) has no exports 00010000:00010000:0.0:1787574387.832955:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574387.832973:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf7a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xfe91058e646bf7ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574387.832998:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a1d2aba00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:0.0:1787574387.833003:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf7a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xfe91058e646bf7ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574387.833016:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf7a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xfe91058e646bf7ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574387.833033:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf7a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xfe91058e646bf7ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574387.833041:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787574387.833043:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1787574387.833047:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1787574387.833074:0:5819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff982a034d2000 00010000:00010000:0.0:1787574387.833078:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf7a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xfe91058e646bf7ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574387.833085:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a1d2aba00/0xfe91058e646bf7a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xfe91058e646bf7ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574387.833102:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574387.833105:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a42045e00/0xfe91058e646bf9cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfe91058e646bf9d6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574387.833135:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a42045e00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:0.0:1787574387.833138:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a42045e00/0xfe91058e646bf9cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfe91058e646bf9d6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574387.833145:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a42045e00/0xfe91058e646bf9cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xfe91058e646bf9d6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574387.833151:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a42045e00/0xfe91058e646bf9cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xfe91058e646bf9d6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574387.833157:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787574387.833159:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787574387.833162:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787574387.833213:0:5819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff982a034d2000 00010000:00010000:0.0:1787574387.833216:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a42045e00/0xfe91058e646bf9cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xfe91058e646bf9d6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574387.833223:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a42045e00/0xfe91058e646bf9cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xfe91058e646bf9d6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574387.833233:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574387.833235:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574387.833237:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574387.834602:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787574387.836848:0:13072:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff982a3a8171e0 - data ffff982a3feccd80/ffff982a41987400 00000020:01000000:1.0:1787574387.838669:0:13072:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff982a3a800ea0 - data ffff982a2b811e58/ffff982904ee5c00 00100000:10000000:1.0:1787574387.848162:0:13072:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787574387.885281:0:13072:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf5b5 00000020:00000080:1.0:1787574387.885293:0:13072:0:(genops.c:885:class_export_put()) final put ffff982904c22800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787574387.885311:0:13072:0:(tgt_mount.c:187:server_put_mount()) put mount ffff982a41658000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787574387.885315:0:13072:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982a41658000 2 00000020:01000004:1.0:1787574387.885319:0:13072:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff982a41658000 from lustre-OST0000 00000020:00000080:1.0:1787574387.885349:0:13072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787574387.885362:0:13072:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787574387.885365:0:13072:0:(genops.c:885:class_export_put()) final put ffff982904c26000/lustre-OST0000_UUID 00000020:00000080:1.0:1787574387.885369:0:13072:0:(genops.c:844:class_export_destroy()) destroying export ffff982904c26000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787574387.885377:0:13072:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1787574387.885424:0:13072:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1787574387.885429:0:13072:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787574387.885434:0:13072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574387.885439:0:13072:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787574387.885447:0:13072:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff982904f31800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:0.0:1787574387.885548:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982904c22800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:1.0:1787574387.885575:0:13072:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff982a048899b8) has exports, disconnecting them 00000020:00080000:1.0:1787574387.885582:0:13072:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff982904f31800), last request at 1787574172 00000020:00000080:1.0:1787574387.885587:0:13072:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf5df 00000020:00080000:1.0:1787574387.885605:0:13072:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff982904f31800): rc 0 00000020:00000080:1.0:1787574387.885611:0:13072:0:(genops.c:885:class_export_put()) final put ffff982904f31800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787574387.885773:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982904f31800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787574387.892382:0:13072:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787574387.892395:0:13072:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787574387.892401:0:13072:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787574387.892422:0:13072:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787574387.892598:0:13072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787574387.892607:0:13072:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1787574387.892615:0:13072:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982a41658000 1 00000020:00000080:0.0:1787574387.892623:0:13072:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf56f 00000020:00000080:0.0:1787574387.892633:0:13072:0:(genops.c:885:class_export_put()) final put ffff982a3a827800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787574387.892638:0:13072:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787574387.892642:0:13072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787574387.892646:0:13072:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787574387.892649:0:13072:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff982a035619b8) has no exports 00000020:00000080:3.0:1787574387.892742:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982904f35800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787574387.892751:0:467:0:(genops.c:885:class_export_put()) final put ffff982a0571c800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787574387.892754:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982a0571c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787574387.892767:0:467:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787574387.892845:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982a3a827800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787574387.912920:0:13072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787574387.912936:0:13072:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787574387.912942:0:13072:0:(genops.c:885:class_export_put()) final put ffff982a0622b000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787574387.912946:0:13072:0:(genops.c:844:class_export_destroy()) destroying export ffff982a0622b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787574387.912953:0:13072:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787574387.913099:0:13072:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff982a41658800 00000020:02000400:0.0:1787574387.913155:0:13072:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787574388.475513:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574389.497435:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574390.513687:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787574391.002724:0:13225:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1787574391.011347:0:13225:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787574391.011439:0:13225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf77c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574391.011474:0:13225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf77c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574391.011483:0:13225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf77c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xfe91058e646bf783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574391.011491:0:13225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf77c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xfe91058e646bf783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574391.011515:0:13225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787574391.011522:0:13225:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1787574391.011540:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574391.011548:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf77c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xfe91058e646bf783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787574391.011549:0:13225:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1787574391.011556:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00031400 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:2.0:1787574391.011560:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf77c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xfe91058e646bf783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574391.011561:0:13225:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff982a419a1c00 x1874407290129792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574392 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787574391.011571:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf77c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xfe91058e646bf783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574391.011579:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf77c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xfe91058e646bf783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574391.011585:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787574391.011587:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787574391.011590:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787574391.011606:0:5818:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff982a034d2000 00010000:00010000:2.0:1787574391.011610:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf77c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xfe91058e646bf783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574391.011617:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a00031400/0xfe91058e646bf77c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xfe91058e646bf783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574391.011629:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574391.011631:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574391.011633:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574391.016051:0:13225:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff982a3adf2a00 x1874407290130304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574397 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574391.016074:0:13225:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff982a40fe0380 x1874407290130432/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574398 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574391.016097:0:13225:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff982a3adf3480 x1874407290130688/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574403 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574391.016106:0:13225:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787574391.016115:0:13225:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787574391.016147:0:13225:0:(import.c:65:import_set_state_nolock()) ffff982a4192c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787574391.016240:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874407290130304:0@lo:400:kworker.0 00000100:00100000:0.0:1787574391.016241:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290130688:0@lo:400:kworker.0 00000100:00100000:0.0:1787574391.016251:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290129792:0@lo:400:kworker.0 00000100:00100000:0.0:1787574391.016363:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874407290130432:0@lo:400:kworker.0 00000100:00100000:2.0:1787574391.019427:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1874407290130816:0@lo:39:umount.0 00000400:00000100:2.0:1787574391.020531:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407290130816 offset 0 length 224: 4 00010000:00010000:3.0:1787574391.537955:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574392.564336:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787574392.945466:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7182851c-b624-4982-87cf-e891100b1765->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787574392.945478:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7182851c-b624-4982-87cf-e891100b1765->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1787574393.589981:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574394.612818:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574395.633588:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574396.658537:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574397.683491:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787574398.065659:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7182851c-b624-4982-87cf-e891100b1765->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787574398.065672:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7182851c-b624-4982-87cf-e891100b1765->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787574398.709945:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574399.730037:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574400.753592:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574401.265940:0:3297:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574391/real 1787574391] req@ffff982a419a0700 x1874407290130816/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787574401 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574401.265976:0:3297:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff982a419a0700 x1874407290130816/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787574401 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787574401.265996:0:3297:0:(import.c:65:import_set_state_nolock()) ffff982a4192c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787574401.266019:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1874407290130816:0@lo:39:umount.0 00000100:00080000:1.0:1787574401.266309:0:13225:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787574401.266314:0:13225:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787574401.266319:0:13225:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787574401.270068:0:13225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf78a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf791 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574401.271868:0:13225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf78a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf791 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574401.271885:0:13225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf78a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfe91058e646bf791 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574401.271893:0:13225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf78a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfe91058e646bf791 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574401.271927:0:13225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787574401.271935:0:13225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42045800/0xfe91058e646bf9c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646bf9c8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574401.271943:0:13225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42045800/0xfe91058e646bf9c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646bf9c8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574401.271949:0:13225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a42045800/0xfe91058e646bf9c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfe91058e646bf9c8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574401.271955:0:13225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff982a42045800/0xfe91058e646bf9c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfe91058e646bf9c8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574401.272121:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574401.272256:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf78a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfe91058e646bf791 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574401.272264:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a027f2e00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1787574401.272268:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf78a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfe91058e646bf791 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574401.272278:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf78a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xfe91058e646bf791 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574401.272298:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf78a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xfe91058e646bf791 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574401.272305:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574401.272314:0:13225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787574401.272320:0:13225:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 10000000:01000000:3.0:1787574401.272322:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1787574401.272326:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1787574401.272340:0:5819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff982a034d2000 00010000:00010000:3.0:1787574401.272345:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf78a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xfe91058e646bf791 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787574401.272351:0:13225:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00010000:00010000:3.0:1787574401.272352:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a027f2e00/0xfe91058e646bf78a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xfe91058e646bf791 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1787574401.272358:0:13225:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787574401.272365:0:13225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1787574401.272371:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00000080:1.0:1787574401.272371:0:13225:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787574401.272376:0:13225:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff982a03e919b8) has no exports 00010000:00010000:3.0:1787574401.272377:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a42045800/0xfe91058e646bf9c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfe91058e646bf9c8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787574401.272409:0:13225:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff982a03e919b8) has no exports 00010000:00010000:2.0:1787574401.272977:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574401.273275:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a42045800 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1787574401.273280:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a42045800/0xfe91058e646bf9c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfe91058e646bf9c8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574401.273289:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a42045800/0xfe91058e646bf9c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xfe91058e646bf9c8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574401.273295:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a42045800/0xfe91058e646bf9c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xfe91058e646bf9c8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574401.273300:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787574401.273303:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787574401.273305:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787574401.273315:0:5819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff982a034d2000 00010000:00010000:3.0:1787574401.273319:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a42045800/0xfe91058e646bf9c1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xfe91058e646bf9c8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574401.273326:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a42045800/0xfe91058e646bf9c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xfe91058e646bf9c8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574401.273353:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574401.273355:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574401.273358:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787574401.276065:0:13225:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff982a418b42a0 - data ffff982a3fe4c510/ffff982a41958400 00000020:01000000:1.0:1787574401.279228:0:13225:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff982a113492a0 - data ffff982a3fe11438/ffff982a41914800 00100000:10000000:1.0:1787574401.289573:0:13225:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787574401.342414:0:13225:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf680 00000020:00000080:2.0:1787574401.342423:0:13225:0:(genops.c:885:class_export_put()) final put ffff982906b8d800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787574401.342443:0:13225:0:(tgt_mount.c:187:server_put_mount()) put mount ffff982a3a5c3000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787574401.342447:0:13225:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982a3a5c3000 2 00000020:01000004:2.0:1787574401.342451:0:13225:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff982a3a5c3000 from lustre-OST0001 00000020:00000080:2.0:1787574401.342502:0:13225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787574401.342515:0:13225:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787574401.342519:0:13225:0:(genops.c:885:class_export_put()) final put ffff982906b8b000/lustre-OST0001_UUID 00000020:00000080:2.0:1787574401.342522:0:13225:0:(genops.c:844:class_export_destroy()) destroying export ffff982906b8b000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787574401.342529:0:13225:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:0.0:1787574401.342657:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982906b8d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:2.0:1787574401.342816:0:13225:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 7182851c-b624-4982-87cf-e891100b1765->MGS 00010000:00010000:2.0:1787574401.342834:0:13225:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a42044e00/0xfe91058e646bf592 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xfe91058e646bf599 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574401.342846:0:13225:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a42044e00/0xfe91058e646bf592 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xfe91058e646bf599 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574401.342853:0:13225:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787574401.342856:0:13225:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787574401.342859:0:13225:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787574401.342872:0:13225:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff982a034d2000 00010000:00010000:2.0:1787574401.342885:0:13225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a42044e00/0xfe91058e646bf592 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xfe91058e646bf599 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574401.342915:0:13225:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf7d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xfe91058e646bf7d7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574401.342923:0:13225:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf7d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xfe91058e646bf7d7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574401.342928:0:13225:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787574401.342931:0:13225:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787574401.342932:0:13225:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787574401.342947:0:13225:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff982a034d2000 00010000:00010000:2.0:1787574401.342950:0:13225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a00030c00/0xfe91058e646bf7d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xfe91058e646bf7d7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787574401.342967:0:13225:0:(import.c:65:import_set_state_nolock()) ffff982a034d2000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787574401.342970:0:13225:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787574401.342973:0:13225:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787574401.342974:0:13225:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787574401.342978:0:13225:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787574401.342988:0:13225:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff982a3adf0a80 x1874407290130560/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787574402 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787574401.343012:0:13225:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787574401.343058:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7182851c-b624-4982-87cf-e891100b1765:3297:1874407290130560:0@lo:250:kworker.0 00000100:00100000:2.0:1787574401.343102:0:13225:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787574401.343105:0:13225:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787574401.343112:0:13225:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf473 00000020:00000080:2.0:1787574401.343116:0:13225:0:(genops.c:885:class_export_put()) final put ffff982a04936000/7182851c-b624-4982-87cf-e891100b1765 00000020:01000000:2.0:1787574401.343129:0:13225:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.151@tcp (flags='') 00000020:00000080:2.0:1787574401.343133:0:13225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787574401.343138:0:13225:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.151@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787574401.343142:0:13225:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff982a0488b370) has no exports 10000000:01000000:0.0:1787574401.343254:0:5827:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:0.0:1787574401.343426:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982a04936000/7182851c-b624-4982-87cf-e891100b1765 for MGC192.168.206.151@tcp 10000000:01000000:0.0:1787574401.343438:0:13225:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.151@tcp: client import never connected 00000100:00080000:0.0:1787574401.343441:0:13225:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787574401.343443:0:13225:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787574401.343445:0:13225:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787574401.343446:0:13225:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787574401.343501:0:13225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787574401.343506:0:13225:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.151@tcp (uuid 7182851c-b624-4982-87cf-e891100b1765) 00000020:01000000:0.0:1787574401.343511:0:13225:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787574401.343514:0:13225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787574401.343518:0:13225:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787574401.343522:0:13225:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff982a2e0de800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787574401.343527:0:13225:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff982a03564d28) has exports, disconnecting them 00000020:00080000:0.0:1787574401.343532:0:13225:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff982a2e0de800), last request at 1787574190 00000020:00000080:0.0:1787574401.343536:0:13225:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf6aa 00000020:00080000:0.0:1787574401.343548:0:13225:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff982a2e0de800): rc 0 00000020:00000080:0.0:1787574401.343551:0:13225:0:(genops.c:885:class_export_put()) final put ffff982a2e0de800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787574401.343984:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982a034d2000 for MGC192.168.206.151@tcp 00000020:00000080:2.0:1787574401.343992:0:467:0:(genops.c:885:class_export_put()) final put ffff982a0489d800/7182851c-b624-4982-87cf-e891100b1765 00000020:00000080:2.0:1787574401.343994:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982a0489d800/7182851c-b624-4982-87cf-e891100b1765 for MGC192.168.206.151@tcp 00000020:01000000:2.0:1787574401.343999:0:467:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.151@tcp (7182851c-b624-4982-87cf-e891100b1765) 00000020:00000080:2.0:1787574401.344233:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982a2e0de800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1787574401.373620:0:13225:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787574401.373628:0:13225:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787574401.373634:0:13225:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787574401.373642:0:13225:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787574401.373799:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982a4192c000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1787574401.373888:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787574401.373988:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1787574401.376020:0:5814:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff982a05036400:5814] 1 exiting: rc = 0 00000100:00100000:3.0:1787574401.376117:0:5813:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff982a2e09c200:5813] 0 exiting: rc = 1 00000100:00100000:1.0:1787574401.376622:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574401.377131:0:5815:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff982a05037a00:5815] 0 exiting: rc = 1 00000100:00100000:1.0:1787574401.377570:0:5817:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff982a064e7400:5817] 2 exiting: rc = 0 00000100:00100000:2.0:1787574401.377704:0:8453:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff982904f29800:8453] 3 exiting: rc = 0 00000100:00100000:2.0:1787574401.378363:0:5816:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff982a064e7600:5816] 1 exiting: rc = 0 00000100:00100000:1.0:1787574401.380556:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380568:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380574:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380580:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380586:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380592:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380598:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380604:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380611:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380618:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380624:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380629:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380634:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380640:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380646:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380652:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380658:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380663:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380668:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380674:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380679:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380683:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380688:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.380706:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381288:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381297:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381303:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381308:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381314:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381319:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381328:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381334:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381352:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381357:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381363:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381368:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381810:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381820:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381825:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381831:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381836:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381841:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381847:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381920:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381927:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381932:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381936:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381942:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381946:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381952:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381957:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381962:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381967:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381971:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381976:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381981:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381986:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.381990:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.382008:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.382013:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.382017:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.382022:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.382027:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.382032:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787574401.385108:0:13225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787574401.385122:0:13225:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787574401.385127:0:13225:0:(genops.c:885:class_export_put()) final put ffff982a3a825000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787574401.385132:0:13225:0:(genops.c:844:class_export_destroy()) destroying export ffff982a3a825000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787574401.385138:0:13225:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1787574401.385276:0:13225:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982a3a5c3000 1 00000020:00000080:2.0:1787574401.385282:0:13225:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfe91058e646bf64f 00000020:00000080:2.0:1787574401.385289:0:13225:0:(genops.c:885:class_export_put()) final put ffff982904ed8000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787574401.385308:0:13225:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787574401.385313:0:13225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787574401.385318:0:13225:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787574401.385322:0:13225:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff982904c799b8) has no exports 00000020:00000080:0.0:1787574401.385344:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff982904ed8000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787574401.414693:0:13225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787574401.414707:0:13225:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787574401.414723:0:13225:0:(genops.c:885:class_export_put()) final put ffff982904c20000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787574401.414728:0:13225:0:(genops.c:844:class_export_destroy()) destroying export ffff982904c20000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787574401.414746:0:13225:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787574401.414935:0:13225:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff982904c26800 00000020:01000000:2.0:1787574401.414954:0:13225:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787574401.414958:0:13225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787574401.414962:0:13225:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787574401.414974:0:13225:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff982a03e93370) has no exports 00000020:00000080:2.0:1787574401.414998:0:13225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787574401.415003:0:13225:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787574401.415006:0:13225:0:(genops.c:885:class_export_put()) final put ffff982a3a825800/OSS_uuid 00000020:00000080:2.0:1787574401.415008:0:13225:0:(genops.c:844:class_export_destroy()) destroying export ffff982a3a825800/OSS_uuid for OSS 00000020:01000000:2.0:1787574401.415011:0:13225:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1787574401.415201:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff982a08295200:6683] 2 exiting: rc = 0 00000100:00080000:0.0:1787574401.415283:0:5826:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787574401.415373:0:12475:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff98290461f800:12475] 4 exiting: rc = 0 00000100:00100000:2.0:1787574401.416351:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff982a08297400:6681] 0 exiting: rc = 1 00000100:00100000:2.0:1787574401.416437:0:8472:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff982a11327e00:8472] 3 exiting: rc = 0 00000100:00100000:2.0:1787574401.418274:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff982a08294400:6682] 1 exiting: rc = 0 00000100:00100000:0.0:1787574401.418450:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418459:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418465:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418473:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418478:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418484:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418490:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418496:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418501:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418506:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418511:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418534:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418540:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418545:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418550:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418561:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418566:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418571:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418576:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418581:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418586:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418591:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418596:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418601:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418607:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418611:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418616:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418620:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418625:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418629:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418634:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418640:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418645:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418650:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418655:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418660:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418664:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418669:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418674:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418678:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418682:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418687:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418692:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418697:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418705:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418710:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418746:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418752:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418758:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418763:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418769:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418774:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418781:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418788:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418794:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418799:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418804:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418810:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418815:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418821:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418826:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418832:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418837:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.418842:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.419662:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff982a08294000:6684] 0 exiting: rc = 1 00000100:00100000:2.0:1787574401.419878:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff982a3aae7200:6686] 1 exiting: rc = 0 00000100:00100000:0.0:1787574401.420324:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420333:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420338:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420343:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420348:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420354:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420359:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420364:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420370:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420375:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420444:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420450:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420455:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420460:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420464:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420470:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420475:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420493:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420498:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420503:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420508:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420513:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420518:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420524:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420529:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420534:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420540:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420546:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420553:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420557:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420562:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420568:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420574:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420579:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420584:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420589:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420594:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420600:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420605:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420610:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420615:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420620:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420626:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420631:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420636:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420642:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420647:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420653:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420659:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420664:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420669:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420674:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420687:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420693:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420698:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420703:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420708:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420725:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.420731:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.421479:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.421492:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.421497:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.421502:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574401.421507:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.429977:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff982a3a019e00:6688] 1 exiting: rc = 0 00000100:00100000:3.0:1787574401.430071:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff982a3a019a00:6687] 0 exiting: rc = 1 00000100:00100000:0.0:1787574401.430267:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff982a3eb8b000:6689] 2 exiting: rc = 0 00000100:00100000:1.0:1787574401.430361:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430370:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430378:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430385:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430391:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430396:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430409:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430416:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430422:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430428:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430434:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430440:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430445:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430452:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430459:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430468:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430477:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430485:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430508:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430517:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430525:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430532:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430540:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430562:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430570:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430591:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430599:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430606:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430614:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430621:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430629:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430637:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430643:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430651:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430660:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430668:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430685:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430694:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430702:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430710:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430726:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430734:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430740:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430746:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430752:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430757:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430762:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430782:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430788:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430794:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430800:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430806:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430811:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430816:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430822:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430838:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430844:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430850:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430856:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430862:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430893:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430903:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430911:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.430994:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574401.440833:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff982a3eb8aa00:6690] 0 exiting: rc = 1 00000100:00100000:0.0:1787574401.441096:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff982a3eb8a600:6691] 1 exiting: rc = 0 00000100:00100000:2.0:1787574401.441216:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441223:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441229:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441234:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441239:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441244:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441250:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441256:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441262:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441267:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441272:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441278:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441283:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441289:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441294:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441300:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441305:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441311:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441316:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441322:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441327:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441333:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441338:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441346:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441365:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441372:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441378:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441547:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441552:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441557:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441562:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441567:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441572:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441577:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441582:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441587:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441592:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441598:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441604:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441609:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441615:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441620:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441625:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441630:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441635:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441640:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441645:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441650:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441656:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441661:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441667:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441672:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441678:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441683:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441688:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441694:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441699:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441704:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441709:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441742:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441748:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441755:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441761:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.441767:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574401.448395:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff982a04dca800:6692] 0 exiting: rc = 1 00000100:00100000:0.0:1787574401.448799:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff982a3eb91e00:6693] 1 exiting: rc = 0 00000100:00100000:2.0:1787574401.448886:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.448904:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.448913:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.448919:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.448927:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.448934:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.448940:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.448946:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.448952:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.448959:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.448985:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.448993:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.448999:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449007:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449013:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449019:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449025:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449032:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449039:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449045:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449052:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449057:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449079:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449094:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449100:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449110:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449117:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449124:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449130:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449136:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449155:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449161:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449190:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449199:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449226:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449233:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449239:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449245:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449251:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449257:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449262:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449268:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449275:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449280:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449286:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449294:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449317:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449325:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449332:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449338:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449343:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449349:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449354:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449361:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449367:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449373:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449390:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449397:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449416:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449424:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449430:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449436:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449443:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574401.449449:0:13225:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787574401.460834:0:13225:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787574416.541705:0:13843:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787574423.608468:0:14306:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787574423.608477:0:14306:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787574423.608625:0:14306:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff982905b62800 00000020:01000004:2.0:1787574423.608645:0:14306:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787574423.608655:0:14306:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787574423.608673:0:14306:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff982a03564d28) 00000020:00000080:2.0:1787574423.608692:0:14306:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787574423.636937:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787574423.640546:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787574423.641131:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1787574423.641403:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1787574423.641614:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787574423.641683:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1787574423.641912:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1787574423.642081:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1787574423.642385:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1787574423.642846:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1787574423.645914:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 183: rc = 0 00100000:10000000:2.0:1787574423.646076:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 183: rc = 0 00100000:10000000:2.0:1787574423.646935:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 650: rc = 0 00100000:10000000:2.0:1787574423.647540:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 650: rc = 0 00100000:10000000:2.0:1787574423.647899:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 650: rc = 0 00100000:10000000:2.0:1787574423.649059:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 650: rc = 0 00100000:10000000:2.0:1787574423.649386:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 650: rc = 0 00100000:10000000:2.0:1787574423.649664:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 650: rc = 0 00100000:10000000:2.0:1787574423.649932:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 650: rc = 0 00100000:10000000:2.0:1787574423.650223:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 650: rc = 0 00100000:10000000:2.0:1787574423.651377:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 650: rc = 0 00100000:10000000:2.0:1787574423.651868:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 650: rc = 0 00100000:10000000:2.0:1787574423.652139:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 650: rc = 0 00100000:10000000:2.0:1787574423.652672:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 650: rc = 0 00100000:10000000:2.0:1787574423.653881:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 201: rc = 0 00100000:10000000:2.0:1787574423.654162:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 201: rc = 0 00100000:10000000:2.0:1787574423.657912:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 201: rc = 0 00100000:10000000:2.0:1787574423.658585:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 201: rc = 0 00100000:10000000:2.0:1787574423.659136:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 201: rc = 0 00100000:10000000:2.0:1787574423.659754:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 201: rc = 0 00100000:10000000:2.0:1787574423.660021:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 201: rc = 0 00100000:10000000:2.0:1787574423.660631:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 201: rc = 0 00100000:10000000:2.0:1787574423.660970:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 201: rc = 0 00100000:10000000:2.0:1787574423.661763:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 201: rc = 0 00100000:10000000:2.0:1787574423.663098:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 201: rc = 0 00100000:10000000:2.0:1787574423.663862:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 201: rc = 0 00100000:10000000:2.0:1787574423.664119:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 201: rc = 0 00100000:10000000:2.0:1787574423.664814:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 201: rc = 0 00100000:10000000:2.0:1787574423.665082:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 201: rc = 0 00100000:10000000:2.0:1787574423.666115:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 201: rc = 0 00100000:10000000:2.0:1787574423.666891:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 201: rc = 0 00100000:10000000:2.0:1787574423.667529:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 201: rc = 0 00100000:10000000:2.0:1787574423.668922:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 201: rc = 0 00100000:10000000:2.0:1787574423.669383:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 201: rc = 0 00100000:10000000:2.0:1787574423.669738:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 201: rc = 0 00100000:10000000:2.0:1787574423.670015:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 201: rc = 0 00100000:10000000:2.0:1787574423.670365:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 201: rc = 0 00100000:10000000:2.0:1787574423.670757:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 201: rc = 0 00100000:10000000:2.0:1787574423.671013:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 201: rc = 0 00100000:10000000:2.0:1787574423.671569:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 201: rc = 0 00100000:10000000:2.0:1787574423.671851:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 201: rc = 0 00100000:10000000:2.0:1787574423.672100:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 201: rc = 0 00100000:10000000:2.0:1787574423.672401:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 201: rc = 0 00100000:10000000:2.0:1787574423.672888:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 201: rc = 0 00100000:10000000:2.0:1787574423.673151:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 201: rc = 0 00100000:10000000:2.0:1787574423.673518:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 201: rc = 0 00100000:10000000:2.0:1787574423.674711:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 658: rc = 0 00100000:10000000:2.0:1787574423.675803:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787574423.675998:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 184: rc = 0 00100000:10000000:2.0:1787574423.676361:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1787574423.676435:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 184: rc = 0 00100000:10000000:2.0:1787574423.676705:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1787574423.676771:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 184: rc = 0 00100000:10000000:2.0:1787574423.677194:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787574423.677337:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 352: rc = 0 00100000:10000000:2.0:1787574423.677539:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1787574423.677678:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 352: rc = 0 00100000:10000000:2.0:1787574423.677865:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1787574423.677935:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 352: rc = 0 00000020:00000080:3.0:1787574423.678568:0:14306:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787574423.678580:0:14306:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787574423.678655:0:14306:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfe91058e646c0774 00000020:01000004:3.0:1787574423.678668:0:14306:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787574423.678674:0:14306:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787574423.678682:0:14306:0:(tgt_mount.c:101:server_register_mount()) register mount ffff982905b62800 from MGS 00000020:01000004:3.0:1787574423.678687:0:14306:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787574423.678700:0:14306:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff982a048899b8) 00000020:00000080:3.0:1787574423.678712:0:14306:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787574423.678777:0:14306:0:(tgt_mount.c:153:server_get_mount()) get mount ffff982905b62800 from MGS, refs=2 00080000:01000000:3.0:1787574423.678784:0:14306:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787574423.678790:0:14306:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfe91058e646c0782 00000100:00100000:3.0:1787574423.678913:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787574423.679058:0:14306:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787574423.679064:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787574423.679580:0:14306:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787574423.679588:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787574423.681582:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574423.681802:0:14306:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787574423.681810:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787574423.683329:0:14306:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787574423.683343:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787574423.683702:0:14306:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787574423.683709:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787574423.684435:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574423.684439:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574423.684442:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574423.684735:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574423.684738:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574423.684746:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574423.685479:0:14306:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787574423.696489:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787574423.706998:0:14306:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787574423.707023:0:14306:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787574423.707026:0:14306:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787574423.708862:0:14315:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787574423.709004:0:14306:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787574423.709099:0:14306:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787574423.709725:0:14306:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787574423.710087:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787574423.710425:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787574423.710433:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787574423.725677:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787574423.726357:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787574423.730525:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787574423.730541:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787574423.731461:0:14306:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787574423.731486:0:14306:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.151@tcp' 00000020:01000004:1.0:1787574423.731488:0:14306:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787574423.731523:0:14306:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.151@tcp (typ=mgc) 00000020:00000080:1.0:1787574423.731537:0:14306:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.151@tcp (ffff982a03e93370) 00000020:00000080:1.0:1787574423.731557:0:14306:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:0.0:1787574423.731764:0:14320:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:1.0:1787574423.732109:0:14306:0:(ldlm_lib.c:102:import_set_conn()) imp ffff982a41c22800@MGC192.168.206.151@tcp: add connection 192.168.206.151@tcp at head 00010000:00010000:1.0:1787574423.733272:0:14306:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.151@tcp-0 is initialized 00000040:01000000:1.0:1787574423.733283:0:14306:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787574423.735665:0:14321:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787574423.735763:0:14306:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.151@tcp (uuid b2841886-4ae8-43da-bc7c-46b9b13f805e) 00000020:00000080:1.0:1787574423.735794:0:14306:0:(genops.c:1385:class_connect()) connect: client b2841886-4ae8-43da-bc7c-46b9b13f805e, cookie 0xfe91058e646c0790 00000100:00080000:1.0:1787574423.735809:0:14306:0:(import.c:510:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787574423.735817:0:14306:0:(import.c:624:import_select_connection()) MGC192.168.206.151@tcp: import ffff982a41c22800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1787574423.735872:0:14306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982a419a2300 x1874407290130944/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787574423.735904:0:14306:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b2841886-4ae8-43da-bc7c-46b9b13f805e->MGS 00000020:01000004:1.0:1787574423.735945:0:14306:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000100:00100000:3.0:1787574423.735951:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b2841886-4ae8-43da-bc7c-46b9b13f805e:3297:1874407290130944:0@lo:250:mount.lustre.0 00000020:01000004:1.0:1787574423.735952:0:14306:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787574423.735969:0:14306:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff982a03e919b8) 00000020:00000080:1.0:1787574423.735986:0:14306:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787574423.736048:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574423.736348:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290130944 00000100:00100000:3.0:1787574423.736358:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290130944 00000100:00100000:3.0:1787574423.736392:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787574423.736402:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3b95d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3297:x1874407290130944:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1787574423.736429:0:14316:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b2841886-4ae8-43da-bc7c-46b9b13f805e@0@lo t0 exp 0000000000000000 cur 399 last 0 00000020:00000080:3.0:1787574423.736451:0:14316:0:(genops.c:1385:class_connect()) connect: client b2841886-4ae8-43da-bc7c-46b9b13f805e, cookie 0xfe91058e646c079e 00000100:00080000:3.0:1787574423.736615:0:14316:0:(import.c:65:import_set_state_nolock()) ffff982a03007800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787574423.736683:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3b95d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+5:3297:x1874407290130944:12345-0@lo:250:mount.lustre.0 Request processed in 281us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574423.736691:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787574423.736729:0:3297:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787574423.736738:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.151@tcp: connect to target with instance 0 00000100:00080000:3.0:1787574423.736745:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787574423.736749:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787574423.736753:0:3297:0:(import.c:65:import_set_state_nolock()) ffff982a41c22800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787574423.736756:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787574423.736770:0:3297:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787574423.736776:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b2841886-4ae8-43da-bc7c-46b9b13f805e:3297:1874407290130944:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787574423.765030:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787574423.765552:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787574423.765559:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787574423.768911:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787574423.768932:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787574423.772432:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787574423.772448:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787574423.776760:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787574423.777648:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787574423.777658:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787574423.780112:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787574423.780131:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787574423.858240:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787574423.858653:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787574423.858662:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787574423.864759:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787574423.864918:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787574423.865976:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787574423.866479:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787574423.866486:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787574423.868074:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787574423.868086:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787574423.869560:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787574423.869801:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787574423.869808:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787574423.870450:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787574423.870458:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787574423.871743:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787574423.871951:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787574423.871957:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787574423.889926:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787574423.889979:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787574423.927611:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787574423.927922:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787574423.927928:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787574423.929550:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787574423.929563:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787574423.931695:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787574423.931713:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787574423.933043:0:14306:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787574423.933070:0:14306:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787574423.933077:0:14306:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787574423.933310:0:14306:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787574423.933352:0:14306:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787574423.933356:0:14306:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787574423.933358:0:14306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787574423.933359:0:14306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787574423.933361:0:14306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787574423.933362:0:14306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787574423.933363:0:14306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787574423.933365:0:14306:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787574423.933366:0:14306:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787574423.933369:0:14306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787574423.933370:0:14306:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787574423.933372:0:14306:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787574423.933374:0:14306:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787574423.933376:0:14306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787574423.933377:0:14306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787574423.933378:0:14306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787574423.933379:0:14306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787574423.933381:0:14306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787574423.933382:0:14306:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787574423.933383:0:14306:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787574423.933384:0:14306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787574423.933385:0:14306:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787574423.933416:0:14306:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787574423.933437:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290131072:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787574423.933510:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574423.933559:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff982907d41cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574423.933903:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290131072 00000100:00100000:1.0:1787574423.933911:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290131072 00000100:00100000:1.0:1787574423.933959:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787574423.933969:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3b95f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+5:14306:x1874407290131072:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787574423.934015:0:14319:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787574423.934018:0:14319:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787574423.934021:0:14319:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787574423.934439:0:14340:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787574423.935453:0:14319:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1787574423.937032:0:14341:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787574423.937038:0:14341:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787574423.937041:0:14341:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787574423.937076:0:14341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1787574423.937513:0:14319:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787574423.937524:0:14319:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787574423.947125:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3b95f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+5:14306:x1874407290131072:12345-0@lo:253:mount.lustre.0 Request processed in 13147us (13604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574423.947145:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787574423.947507:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290131072:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787574423.947523:0:14306:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787574423.947526:0:14306:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787574423.947528:0:14306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787574423.947529:0:14306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574423.947530:0:14306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574423.947531:0:14306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574423.947532:0:14306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574423.947533:0:14306:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787574423.947535:0:14306:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787574423.947537:0:14306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574423.947538:0:14306:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787574423.947557:0:14306:0:(tgt_mount.c:101:server_register_mount()) register mount ffff982905b62800 from lustre-MDT0000 10000000:01000000:2.0:1787574423.947583:0:14306:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787574423.947585:0:14306:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787574423.947600:0:14306:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff982a03e93370 10000000:01000000:2.0:1787574423.947605:0:14306:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787574423.947612:0:14306:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff982a03e93370 from 1 10000000:01000000:2.0:1787574423.947615:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787574423.947658:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a069fbc00/0xfe91058e646c07a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574423.947669:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a069fbc00/0xfe91058e646c07a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574423.947693:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a069fbc00/0xfe91058e646c07a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574423.947711:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290131200:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787574423.947750:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574423.947820:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a10709240 going to sleep for 11 seconds 00000100:00100000:3.0:1787574423.948141:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290131200 00000100:00100000:3.0:1787574423.948148:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290131200 00000100:00100000:3.0:1787574423.948280:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574423.948289:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3b95e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+5:14306:x1874407290131200:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574423.948303:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574423.948319:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a16143000/0xfe91058e646c07ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646c07a5 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574423.948343:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a16143000/0xfe91058e646c07ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646c07a5 expref: 6 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574423.948353:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a16143000/0xfe91058e646c07ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c07a5 expref: 6 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574423.948361:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16143000, rc 0) 00000100:00100000:3.0:1787574423.948409:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3b95e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+6:14306:x1874407290131200:12345-0@lo:101:mount.lustre.0 Request processed in 122us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574423.948422:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787574423.948579:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290131200:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574423.948605:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a069fbc00/0xfe91058e646c07a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c07ac expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574423.948629:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a069fbc00/0xfe91058e646c07a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646c07ac expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574423.948681:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290131328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787574423.948711:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574423.948746:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff982907d41300 going to sleep for 11 seconds 00000100:00100000:2.0:1787574423.948818:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290131328 00000100:00100000:2.0:1787574423.948899:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290131328 00000100:00100000:2.0:1787574423.948935:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787574423.948942:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3b95f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+6:14306:x1874407290131328:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574423.949292:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3b95f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+6:14306:x1874407290131328:12345-0@lo:501:mount.lustre.0 Request processed in 350us (579us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787574423.949300:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787574423.949458:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290131328:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787574423.949494:0:14306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787574423.949550:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a069fbc00/0xfe91058e646c07a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c07ac expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574423.949559:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a069fbc00/0xfe91058e646c07a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c07ac expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574423.949568:0:14306:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff982905b62800 10000000:01000000:0.0:1787574423.949573:0:14306:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787574423.949578:0:14306:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff982905b62800 10000000:01000000:0.0:1787574423.949580:0:14306:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787574423.949583:0:14306:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff982905b62800 from 1 10000000:01000000:0.0:1787574423.949586:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787574423.949619:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a41d01e00/0xfe91058e646c07b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574423.949627:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a41d01e00/0xfe91058e646c07b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574423.949635:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a41d01e00/0xfe91058e646c07b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574423.949657:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290131456:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787574423.949687:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574423.949718:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff982907d41300 going to sleep for 11 seconds 00000100:00100000:3.0:1787574423.949771:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290131456 00000100:00100000:3.0:1787574423.949777:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290131456 00000100:00100000:3.0:1787574423.949812:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787574423.949819:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3b95dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+6:14306:x1874407290131456:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574423.949838:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574423.949850:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a16143a00/0xfe91058e646c07ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646c07b3 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574423.949868:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a16143a00/0xfe91058e646c07ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646c07b3 expref: 7 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574423.949877:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a16143a00/0xfe91058e646c07ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c07b3 expref: 7 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574423.949894:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16143a00, rc 0) 00000100:00100000:3.0:1787574423.949938:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3b95dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+7:14306:x1874407290131456:12345-0@lo:101:mount.lustre.0 Request processed in 119us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574423.949943:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787574423.950080:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290131456:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574423.950092:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a41d01e00/0xfe91058e646c07b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c07ba expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574423.950100:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a41d01e00/0xfe91058e646c07b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646c07ba expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574423.950114:0:14306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787574423.950397:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a41d01e00/0xfe91058e646c07b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c07ba expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574423.950405:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a41d01e00/0xfe91058e646c07b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c07ba expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574423.950412:0:14306:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787574423.950416:0:14306:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787574423.950421:0:14306:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff982905b62800 10000000:01000000:1.0:1787574423.950424:0:14306:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787574423.950427:0:14306:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787574423.950429:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787574423.950448:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a057e1400/0xfe91058e646c07c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574423.950455:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a057e1400/0xfe91058e646c07c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574423.950462:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a057e1400/0xfe91058e646c07c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574423.950477:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290131584:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787574423.950521:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574423.950552:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0e7c0900 going to sleep for 11 seconds 00000100:00100000:0.0:1787574423.950616:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290131584 00000100:00100000:0.0:1787574423.950621:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290131584 00000100:00100000:0.0:1787574423.950654:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787574423.950662:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907def050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+7:14306:x1874407290131584:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574423.950670:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574423.950680:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a41d00200/0xfe91058e646c07c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646c07c1 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574423.950694:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a41d00200/0xfe91058e646c07c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646c07c1 expref: 8 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574423.950703:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a41d00200/0xfe91058e646c07c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c07c1 expref: 8 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574423.950712:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a41d00200, rc 0) 00000100:00100000:0.0:1787574423.950746:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907def050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+8:14306:x1874407290131584:12345-0@lo:101:mount.lustre.0 Request processed in 86us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574423.950752:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787574423.950856:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290131584:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574423.950867:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a057e1400/0xfe91058e646c07c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c07c8 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574423.950874:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a057e1400/0xfe91058e646c07c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646c07c8 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574423.950920:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290131712:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574423.950946:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574423.950965:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0e7c0900 going to sleep for 11 seconds 00000100:00100000:0.0:1787574423.951072:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290131712 00000100:00100000:0.0:1787574423.951077:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290131712 00000100:00100000:0.0:1787574423.951106:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787574423.951112:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907dee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+8:14306:x1874407290131712:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787574423.951541:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907dee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+9:14306:x1874407290131712:12345-0@lo:501:mount.lustre.0 Request processed in 428us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574423.951558:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787574423.953748:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290131712:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574423.953812:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290131840:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787574423.953894:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574423.953931:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0e7c0900 going to sleep for 11 seconds 00000100:00100000:3.0:1787574423.953998:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290131840 00000100:00100000:3.0:1787574423.954005:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290131840 00000100:00100000:3.0:1787574423.954055:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787574423.954065:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907dec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+9:14306:x1874407290131840:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787574423.954466:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907dec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+9:14306:x1874407290131840:12345-0@lo:503:mount.lustre.0 Request processed in 395us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574423.954474:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787574423.954752:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290131840:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787574423.955139:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2841886-4ae8-43da-bc7c-46b9b13f805e:14342:1874407290131968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574423.955206:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574423.955237:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a10709a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574423.955345:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290131968 00000100:00100000:1.0:1787574423.955350:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290131968 00000100:00100000:1.0:1787574423.955383:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787574423.955390:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907decc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+9:14342:x1874407290131968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574423.956357:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907decc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+9:14342:x1874407290131968:12345-0@lo:502:llog_process_th.0 Request processed in 965us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574423.956367:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787574423.957960:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2841886-4ae8-43da-bc7c-46b9b13f805e:14342:1874407290131968:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787574423.958003:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574423.958015:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574423.958017:0:14342:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787574423.958022:0:14342:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787574423.958025:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787574423.958041:0:14342:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff982a03563370) 00000020:00000080:2.0:1787574423.958061:0:14342:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787574423.958077:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787574423.958158:0:14342:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787574423.958420:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfe91058e646c07d6 00000020:00000080:2.0:1787574423.958705:0:14342:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787574423.958892:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574423.958897:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574423.958899:0:14342:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787574423.958903:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574423.958906:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574423.958907:0:14342:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787574423.958910:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787574423.958920:0:14342:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff982a035619b8) 00000020:00000080:2.0:1787574423.958932:0:14342:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787574423.958936:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787574423.958938:0:14342:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787574423.958941:0:14342:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787574423.958946:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787574423.959005:0:14342:0:(tgt_mount.c:153:server_get_mount()) get mount ffff982905b62800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787574423.959019:0:14342:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff982a03560000) 00000020:00000080:2.0:1787574423.959027:0:14342:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787574423.959073:0:14342:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787574423.959079:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfe91058e646c07eb 00000020:00000080:2.0:1787574423.959467:0:14342:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787574423.959474:0:14342:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787574423.959479:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xfe91058e646c07f2 00080000:01000000:2.0:1787574423.959485:0:14342:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787574423.959487:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfe91058e646c07f9 00010000:00010000:0.0:1787574424.041248:0:14342:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1787574424.041736:0:14342:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1787574424.041922:0:14342:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787574424.042574:0:14342:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff982904c7b370) 00000020:00000080:0.0:1787574424.042605:0:14342:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787574424.042680:0:14342:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787574424.042687:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfe91058e646c0807 00000020:00000080:0.0:1787574424.044720:0:14342:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787574424.048757:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xfe91058e646c080e 00000020:00000080:3.0:1787574424.049915:0:14342:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787574424.049926:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574424.049933:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574424.049935:0:14342:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787574424.049938:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787574424.049941:0:14342:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1787574424.049943:0:14342:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787574424.049944:0:14342:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787574424.049946:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787574424.049949:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574424.049951:0:14342:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787574424.049954:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574424.049958:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574424.049960:0:14342:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787574424.049964:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787574424.050000:0:14342:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787574424.050012:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574424.050015:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574424.050022:0:14342:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787574424.050026:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787574424.050029:0:14342:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787574424.050032:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574424.050033:0:14342:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787574424.050036:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787574424.050041:0:14342:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:3.0:1787574424.050065:0:14342:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787574424.050068:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787574424.050081:0:14342:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff982a0488b370) 00000020:00000080:3.0:1787574424.050095:0:14342:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787574424.050100:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787574424.050150:0:14342:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787574424.050155:0:14342:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787574424.050187:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfe91058e646c081c 00010000:00080000:3.0:1787574424.050215:0:14342:0:(ldlm_lib.c:102:import_set_conn()) imp ffff982a0814b000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1787574424.050438:0:14342:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1787574424.050813:0:14342:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787574424.050857:0:14342:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787574424.052161:0:14342:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787574424.052390:0:14342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787574424.052456:0:14342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787574424.062273:0:14346:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787574424.062281:0:14346:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787574424.072434:0:14342:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787574424.072449:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787574424.072486:0:14342:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787574424.072507:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfe91058e646c0823 00000100:00080000:3.0:1787574424.072518:0:14342:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787574424.072525:0:14342:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff982a0814b000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1787574424.072562:0:14342:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982a3a8aad80 x1874407290132096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787574424.072608:0:14342:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787574424.072687:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574424.072691:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574424.072693:0:14342:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787574424.072696:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787574424.072699:0:14342:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1787574424.072701:0:14342:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787574424.072702:0:14342:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787574424.072704:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787574424.072707:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574424.072708:0:14342:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787574424.072710:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787574424.072715:0:14342:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787574424.072718:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574424.072719:0:14342:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787574424.072722:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787574424.072726:0:14342:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:3.0:1787574424.072751:0:14342:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787574424.072754:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787574424.072767:0:14342:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff982a0488cd28) 00000020:00000080:3.0:1787574424.072777:0:14342:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787574424.072781:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787574424.072831:0:14342:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787574424.072836:0:14342:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787574424.072843:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfe91058e646c0831 00010000:00080000:3.0:1787574424.072905:0:14342:0:(ldlm_lib.c:102:import_set_conn()) imp ffff982a40f8f800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.151@tcp at head 00000100:00100000:0.0:1787574424.073091:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874407290132096:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787574424.073146:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407290132096 offset 0 length 520: 4 00010000:00010000:3.0:1787574424.073825:0:14342:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787574424.076296:0:14342:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787574424.076323:0:14342:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787574424.076905:0:14342:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787574424.076967:0:14342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787574424.077059:0:14342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000020:00000080:1.0:1787574424.078520:0:14342:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787574424.078535:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787574424.078568:0:14342:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787574424.078606:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfe91058e646c0838 00000100:00080000:1.0:1787574424.078616:0:14342:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787574424.078622:0:14342:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff982a40f8f800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1787574424.078656:0:14342:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982a419a1500 x1874407290132224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787574424.078693:0:14342:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787574424.078749:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574424.078753:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574424.078755:0:14342:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787574424.078758:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574424.078762:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574424.078764:0:14342:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787574424.078767:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787574424.078769:0:14342:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787574424.078771:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574424.078773:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574424.078775:0:14342:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787574424.078777:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574424.078779:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574424.078781:0:14342:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787574424.078784:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787574424.078815:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2841886-4ae8-43da-bc7c-46b9b13f805e:14342:1874407290132352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574424.078902:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574424.078939:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0e7c0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574424.079216:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874407290132224:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787574424.079247:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407290132224 offset 0 length 520: 4 00000040:00080000:2.0:1787574424.079612:0:14348:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787574424.079616:0:14348:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1787574424.079764:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290132352 00000100:00100000:1.0:1787574424.079771:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290132352 00000100:00100000:1.0:1787574424.079859:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787574424.079869:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907dee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+9:14342:x1874407290132352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574424.080114:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907dee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+9:14342:x1874407290132352:12345-0@lo:502:llog_process_th.0 Request processed in 246us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574424.080131:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787574424.080257:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2841886-4ae8-43da-bc7c-46b9b13f805e:14342:1874407290132352:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787574424.080283:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574424.080288:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574424.080291:0:14342:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787574424.080294:0:14342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787574424.080646:0:14306:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1787574424.080674:0:14306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787574424.080696:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a057e1400/0xfe91058e646c07c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c07c8 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.080707:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a057e1400/0xfe91058e646c07c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c07c8 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574424.080715:0:14306:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff982905b62800 from 1 10000000:01000000:2.0:1787574424.080718:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787574424.080743:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a069fa800/0xfe91058e646c083f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.080750:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a069fa800/0xfe91058e646c083f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.080759:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a069fa800/0xfe91058e646c083f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574424.080775:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290132480:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787574424.080805:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574424.081145:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a10709cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574424.081261:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290132480 00000100:00100000:1.0:1787574424.081267:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290132480 00000100:00100000:1.0:1787574424.081291:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787574424.081298:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907dec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+9:14306:x1874407290132480:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574424.081307:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574424.081322:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a057e1a00/0xfe91058e646c0846 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646c083f expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574424.081340:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a057e1a00/0xfe91058e646c0846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646c083f expref: 10 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574424.081361:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a057e1a00/0xfe91058e646c0846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c083f expref: 10 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574424.081369:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1a00, rc 0) 00000100:00100000:1.0:1787574424.081400:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907dec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+10:14306:x1874407290132480:12345-0@lo:101:mount.lustre.0 Request processed in 102us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574424.081406:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787574424.081502:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290132480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787574424.081514:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a069fa800/0xfe91058e646c083f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0846 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.081522:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a069fa800/0xfe91058e646c083f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646c0846 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574424.082111:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290132608:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787574424.082249:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574424.082276:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a10709cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574424.082641:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290132608 00000100:00100000:1.0:1787574424.082648:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290132608 00000100:00100000:1.0:1787574424.082684:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787574424.082693:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907dec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+10:14306:x1874407290132608:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787574424.082710:0:14316:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787574424.082715:0:14316:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787574424.082777:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907dec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+10:14306:x1874407290132608:12345-0@lo:256:mount.lustre.0 Request processed in 84us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574424.082784:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787574424.084636:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290132608:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787574424.086449:0:14306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787574424.086471:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a069fa800/0xfe91058e646c083f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0846 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.086484:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a069fa800/0xfe91058e646c083f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0846 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574424.086493:0:14306:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982905b62800 from 1 10000000:01000000:2.0:1787574424.086496:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787574424.086540:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c084d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.086547:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c084d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.086557:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c084d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574424.086580:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290132736:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787574424.086655:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574424.087102:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a10709cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574424.087149:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290132736 00000100:00100000:1.0:1787574424.087156:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290132736 00000100:00100000:1.0:1787574424.087458:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787574424.087468:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907ded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+10:14306:x1874407290132736:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574424.087481:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574424.087496:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a057e1600/0xfe91058e646c0854 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646c084d expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574424.087520:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a057e1600/0xfe91058e646c0854 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646c084d expref: 11 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574424.087529:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a057e1600/0xfe91058e646c0854 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c084d expref: 11 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574424.087537:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1600, rc 0) 00000100:00100000:1.0:1787574424.087602:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907ded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+11:14306:x1874407290132736:12345-0@lo:101:mount.lustre.0 Request processed in 125us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574424.087609:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787574424.087695:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290132736:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787574424.087709:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c084d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0854 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.087733:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c084d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646c0854 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574424.087791:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290132864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574424.087821:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574424.088209:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a10709cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574424.088360:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290132864 00000100:00100000:3.0:1787574424.088366:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290132864 00000100:00100000:0.0:1787574424.088530:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787574424.088540:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907ded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+11:14306:x1874407290132864:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787574424.089336:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907ded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+11:14306:x1874407290132864:12345-0@lo:501:mount.lustre.0 Request processed in 796us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574424.089346:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574424.089540:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290132864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574424.089583:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290132992:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787574424.089640:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574424.089745:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290132992 00000100:00100000:0.0:1787574424.089756:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290132992 00000100:00100000:2.0:1787574424.089828:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a10709cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574424.089869:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787574424.089878:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907dedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+11:14306:x1874407290132992:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787574424.090230:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907dedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+11:14306:x1874407290132992:12345-0@lo:503:mount.lustre.0 Request processed in 353us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574424.090237:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787574424.090315:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290132992:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787574424.090844:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2841886-4ae8-43da-bc7c-46b9b13f805e:14350:1874407290133120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574424.090904:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574424.090934:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a2e0fdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574424.091134:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290133120 00000100:00100000:3.0:1787574424.091140:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290133120 00000100:00100000:3.0:1787574424.091201:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787574424.091209:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907ded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+11:14350:x1874407290133120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574424.091431:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907ded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+11:14350:x1874407290133120:12345-0@lo:502:llog_process_th.0 Request processed in 223us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574424.091439:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787574424.091620:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2841886-4ae8-43da-bc7c-46b9b13f805e:14350:1874407290133120:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787574424.091643:0:14350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574424.091652:0:14350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574424.091654:0:14350:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787574424.091662:0:14350:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982905b62800 00000020:00000080:0.0:1787574424.091767:0:14350:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787574424.091776:0:14350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574424.091778:0:14350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574424.091780:0:14350:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787574424.091783:0:14350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574424.091786:0:14350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574424.091787:0:14350:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787574424.091791:0:14350:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982905b62800 00000020:00000080:0.0:1787574424.091793:0:14350:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787574424.091847:0:14350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574424.091851:0:14350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574424.091852:0:14350:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787574424.091855:0:14350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574424.091858:0:14350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574424.091859:0:14350:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787574424.091863:0:14350:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff982905b62800 00000020:00000080:0.0:1787574424.091870:0:14350:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787574424.092806:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2841886-4ae8-43da-bc7c-46b9b13f805e:14350:1874407290133248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574424.092860:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574424.093464:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a2e0fdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574424.093546:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290133248 00000100:00100000:3.0:1787574424.093553:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290133248 00000100:00100000:3.0:1787574424.093608:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787574424.093619:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907dee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+11:14350:x1874407290133248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574424.093934:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907dee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+11:14350:x1874407290133248:12345-0@lo:502:llog_process_th.0 Request processed in 317us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574424.093942:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787574424.094158:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2841886-4ae8-43da-bc7c-46b9b13f805e:14350:1874407290133248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787574424.094214:0:14350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574424.094222:0:14350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574424.094223:0:14350:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787574424.094228:0:14350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787574424.094511:0:14306:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787574424.094530:0:14306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787574424.094550:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c084d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0854 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574424.094562:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c084d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0854 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574424.094615:0:14306:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787574424.094618:0:14306:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff982905b62800 10000000:01000000:3.0:1787574424.094621:0:14306:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff982905b62800 10000000:01000000:3.0:1787574424.094625:0:14306:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787574424.094631:0:14306:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982905b62800 from 1 10000000:01000000:3.0:1787574424.094634:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787574424.095072:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a16143600/0xfe91058e646c085b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574424.095094:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a16143600/0xfe91058e646c085b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574424.095104:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a16143600/0xfe91058e646c085b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574424.095125:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290133376:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787574424.095193:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574424.095229:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290133376 00000100:00100000:3.0:1787574424.095235:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290133376 00000100:00100000:3.0:1787574424.095269:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787574424.095277:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907defc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+11:14306:x1874407290133376:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574424.095288:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574424.095301:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a16142400/0xfe91058e646c0862 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646c085b expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574424.095320:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a16142400/0xfe91058e646c0862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646c085b expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574424.095329:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a16142400/0xfe91058e646c0862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c085b expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574424.095337:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142400, rc 0) 00000100:00100000:3.0:1787574424.095822:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907defc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:14306:x1874407290133376:12345-0@lo:101:mount.lustre.0 Request processed in 544us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574424.095829:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787574424.095872:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3a6c3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787574424.096311:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290133376:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574424.096329:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a16143600/0xfe91058e646c085b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0862 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574424.096339:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a16143600/0xfe91058e646c085b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646c0862 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574424.097348:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290133504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574424.097705:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574424.097741:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3a6c3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787574424.099366:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290133504 00000100:00100000:1.0:1787574424.099379:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290133504 00000100:00100000:1.0:1787574424.099436:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787574424.099446:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:14306:x1874407290133504:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574424.100305:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:14306:x1874407290133504:12345-0@lo:501:mount.lustre.0 Request processed in 856us (2595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574424.100315:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787574424.100555:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290133504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574424.100616:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290133632:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787574424.100673:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574424.100710:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a3a6c3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787574424.100824:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290133632 00000100:00100000:1.0:1787574424.100829:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290133632 00000100:00100000:1.0:1787574424.100864:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787574424.100872:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:14306:x1874407290133632:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787574424.101282:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:14306:x1874407290133632:12345-0@lo:503:mount.lustre.0 Request processed in 411us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574424.101290:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787574424.101781:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290133632:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787574424.109549:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2841886-4ae8-43da-bc7c-46b9b13f805e:14352:1874407290133760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574424.109815:0:14352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574424.109864:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0e7c0900 going to sleep for 11 seconds 00000100:00100000:0.0:1787574424.110585:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290133760 00000100:00100000:0.0:1787574424.110605:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290133760 00000100:00100000:0.0:1787574424.110652:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787574424.110738:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:14352:x1874407290133760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574424.111634:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:14352:x1874407290133760:12345-0@lo:502:llog_process_th.0 Request processed in 969us (1816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574424.111644:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787574424.111846:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2841886-4ae8-43da-bc7c-46b9b13f805e:14352:1874407290133760:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787574424.112346:0:14352:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787574424.112757:0:14352:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff982a03e94d28) 00000020:00000080:1.0:1787574424.112780:0:14352:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1787574424.112867:0:14352:0:(tgt_mount.c:153:server_get_mount()) get mount ffff982905b62800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787574424.112872:0:14352:0:(tgt_mount.c:187:server_put_mount()) put mount ffff982905b62800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787574424.112874:0:14352:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982905b62800 4 00010000:00080000:1.0:1787574424.112921:0:14352:0:(ldlm_lib.c:102:import_set_conn()) imp ffff982a2e0dd000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:1.0:1787574424.119631:0:14352:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1787574424.119815:0:14352:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787574424.119850:0:14352:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787574424.119865:0:14352:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xfe91058e646c0870 00000100:00080000:1.0:1787574424.119876:0:14352:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787574424.119882:0:14352:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff982a2e0dd000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1787574424.119918:0:14352:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982a419a2a00 x1874407290133888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787574424.119948:0:14352:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787574424.120060:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874407290133888:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787574424.120134:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574424.121069:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2841886-4ae8-43da-bc7c-46b9b13f805e:14352:1874407290134016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574424.121127:0:14352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574424.121195:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a012edb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787574424.121229:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290133888 00000100:00100000:1.0:1787574424.121236:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290133888 00000100:00100000:1.0:1787574424.121276:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787574424.121284:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1874407290133888:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787574424.121385:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787574424.121394:0:3297:0:(import.c:65:import_set_state_nolock()) ffff982a2e0dd000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787574424.121398:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787574424.121411:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874407290133888:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787574424.121425:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1874407290133888:12345-0@lo:38:llog_process_th.0 Request processed in 139us (1289us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787574424.121435:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574424.122829:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290134016 00000100:00100000:2.0:1787574424.122839:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290134016 00000100:00100000:2.0:1787574424.123226:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787574424.123238:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d01a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:14352:x1874407290134016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574424.123897:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d01a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:14352:x1874407290134016:12345-0@lo:502:llog_process_th.0 Request processed in 649us (2757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574424.123908:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787574424.124626:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2841886-4ae8-43da-bc7c-46b9b13f805e:14352:1874407290134016:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787574424.124676:0:14352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787574424.124878:0:14306:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787574424.124912:0:14306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787574424.124935:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a16143600/0xfe91058e646c085b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0862 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.124955:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a16143600/0xfe91058e646c085b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0862 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787574424.125022:0:14306:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787574424.125024:0:14306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787574424.125026:0:14306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574424.125027:0:14306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574424.125029:0:14306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574424.125030:0:14306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574424.125031:0:14306:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787574424.125033:0:14306:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787574424.125034:0:14306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574424.125036:0:14306:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787574424.125039:0:14306:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787574424.125041:0:14306:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787574424.125043:0:14306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787574424.125044:0:14306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574424.125045:0:14306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574424.125046:0:14306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574424.125047:0:14306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574424.125048:0:14306:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787574424.125049:0:14306:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787574424.125051:0:14306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574424.125052:0:14306:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787574424.125073:0:14306:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787574424.125091:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290134144:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787574424.125147:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574424.125202:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a10709cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574424.125355:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290134144 00000100:00100000:0.0:1787574424.125363:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290134144 00000100:00100000:0.0:1787574424.125567:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787574424.125576:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d01b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:14306:x1874407290134144:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787574424.125635:0:14316:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787574424.125649:0:14316:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787574424.181545:0:14316:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787574424.181564:0:14316:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787574424.181863:0:14340:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787574424.181868:0:14340:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787574424.181888:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982a16142600/0xfe91058e646c0877 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574424.181906:0:14340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a057e1a00/0xfe91058e646c0846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c083f expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574424.181914:0:14340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982a16142600/0xfe91058e646c0877 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574424.181952:0:14340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a057e1a00/0xfe91058e646c0846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646c083f expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574424.181982:0:14340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982a057e1a00/0xfe91058e646c0846 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646c083f expref: 12 pid: 14316 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574424.181997:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8ab480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14340:1874407290134272:0@lo:104: 00000100:00100000:3.0:1787574424.182059:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574424.182098:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a07a09540 going to sleep for 11 seconds 00000100:00100000:3.0:1787574424.182136:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290134272 00000100:00100000:3.0:1787574424.182142:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290134272 00000100:00100000:3.0:1787574424.182209:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787574424.182218:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2841886-4ae8-43da-bc7c-46b9b13f805e+3:14340:x1874407290134272:12345-0@lo:104: 00010000:00010000:3.0:1787574424.182230:0:14307:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a069fa800/0xfe91058e646c083f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646c0846 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574424.182277:0:14307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787574424.182283:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2841886-4ae8-43da-bc7c-46b9b13f805e+3:14340:x1874407290134272:12345-0@lo:104: Request processed in 67us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574424.182289:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787574424.182329:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8ab480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14340:1874407290134272:0@lo:104: 00010000:00010000:3.0:1787574424.182347:0:14340:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982a16142600/0xfe91058e646c0877 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.182446:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574424.182452:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a069fa800/0xfe91058e646c083f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646c0846 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.182460:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fa800 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:2.0:1787574424.182463:0:14313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a069fa800/0xfe91058e646c083f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646c0846 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.182485:0:14313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a069fa800/0xfe91058e646c083f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646c0846 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574424.182492:0:14313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a069fa800/0xfe91058e646c083f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646c0846 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574424.182498:0:14313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787574424.182534:0:14313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a069fa800/0xfe91058e646c083f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646c0846 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.182540:0:14313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787574424.182559:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a069fa800/0xfe91058e646c083f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646c0846 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.182566:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a069fa800/0xfe91058e646c083f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646c0846 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.182580:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574424.182582:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574424.182584:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574424.182616:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2841886-4ae8-43da-bc7c-46b9b13f805e:3300:1874407290134400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574424.182646:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574424.182715:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290134400 00000100:00100000:2.0:1787574424.182746:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290134400 00010000:00010000:2.0:1787574424.182766:0:14309:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a057e1a00/0xfe91058e646c0846 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646c083f expref: 13 pid: 14316 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574424.183093:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574424.183103:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2841886-4ae8-43da-bc7c-46b9b13f805e+13:3300:x1874407290134400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574424.183119:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574424.183124:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a057e1a00/0xfe91058e646c0846 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646c083f expref: 13 pid: 14316 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.183135:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a057e1a00/0xfe91058e646c0846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646c083f expref: 13 pid: 14316 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.183154:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a057e1a00/0xfe91058e646c0846 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646c083f expref: 13 pid: 14316 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.183733:0:14309:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982a16142600/0xfe91058e646c0877 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.183745:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a16142600/0xfe91058e646c0877 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787574424.183761:0:14309:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001893380s 00010000:00010000:2.0:1787574424.183765:0:14309:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a16142600/0xfe91058e646c0877 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.183772:0:14309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a16142600/0xfe91058e646c0877 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.183778:0:14309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982a16142600/0xfe91058e646c0877 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.183794:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982a16142600/0xfe91058e646c0877 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.183801:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142600 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574424.183805:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982a16142600/0xfe91058e646c0877 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.183821:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982a16142600/0xfe91058e646c0877 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.183840:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982a16142600/0xfe91058e646c0877 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574424.183851:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574424.183913:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:3300:x1874407290134400:12345-0@lo:103:ldlm_bl.0 Request processed in 812us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574424.183921:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787574424.184042:0:14340:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982a16142600/0xfe91058e646c0877 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574424.184050:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982a16142600/0xfe91058e646c0877 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574424.184056:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a16142600/0xfe91058e646c0877 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574424.184139:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2841886-4ae8-43da-bc7c-46b9b13f805e:3300:1874407290134400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574424.196004:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d01b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+11:14306:x1874407290134144:12345-0@lo:253:mount.lustre.0 Request processed in 70418us (70845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574424.196091:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787574424.197143:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:14306:1874407290134144:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787574424.197183:0:14306:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787574424.197186:0:14306:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787574424.197188:0:14306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787574424.197189:0:14306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574424.197190:0:14306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574424.197191:0:14306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574424.197192:0:14306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574424.197193:0:14306:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787574424.197195:0:14306:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787574424.197196:0:14306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574424.197197:0:14306:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787574424.197211:0:14306:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787574424.207929:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787574424.208140:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787574424.208766:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787574424.208935:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787574424.209842:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787574424.209977:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787574424.217936:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787574424.218214:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787574424.218887:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787574424.219493:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787574424.219923:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787574424.220095:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1787574424.261572:0:14306:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1787574424.262387:0:14306:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787574424.262463:0:14361:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1787574424.262467:0:14361:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1787574424.262899:0:14362:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1787574424.262982:0:14362:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787574424.270415:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787574424.270478:0:14362:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787574424.270483:0:14362:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1787574424.270999:0:14306:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787574424.271332:0:14306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787574424.272083:0:14306:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787574424.272093:0:14306:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787574424.272369:0:14306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787574424.276639:0:14306:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787574424.278365:0:14306:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787574424.278413:0:14306:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787574424.279482:0:14306:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1787574424.281515:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1787574424.288861:0:14306:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787574424.324544:0:14306:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787574424.324577:0:14306:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb5e240d1f988 00100000:10000000:3.0:1787574424.324585:0:14306:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787574424.325226:0:14306:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787574424.325241:0:14306:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787574424.325265:0:14306:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787574424.325290:0:14306:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1787574424.754917:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787574425.137768:0:14357:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787574425.137779:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787574425.138238:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1787574425.138262:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:3.0:1787574425.522447:0:14321:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787574425.522457:0:14321:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff982905b62800 from 6 10000000:01000000:3.0:1787574425.522464:0:14321:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787574425.522523:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a16143800/0xfe91058e646c087e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574425.522545:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a16143800/0xfe91058e646c087e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574425.522561:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a16143800/0xfe91058e646c087e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574425.522603:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290134528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787574425.522690:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574425.522834:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a41251480 going to sleep for 11 seconds 00000100:00100000:2.0:1787574425.522940:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290134528 00000100:00100000:2.0:1787574425.522950:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290134528 00000100:00100000:2.0:1787574425.523012:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787574425.523023:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+11:14321:x1874407290134528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574425.523040:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574425.523057:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a069fac00/0xfe91058e646c0885 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646c087e expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574425.523085:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a069fac00/0xfe91058e646c0885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646c087e expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574425.523096:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a069fac00/0xfe91058e646c0885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c087e expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574425.523107:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fac00, rc 0) 00000100:00100000:2.0:1787574425.523160:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:14321:x1874407290134528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574425.523189:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787574425.523374:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290134528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574425.523394:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a16143800/0xfe91058e646c087e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0885 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574425.523405:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a16143800/0xfe91058e646c087e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646c0885 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574425.523470:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290134656:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787574425.523506:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574425.523540:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a41251480 going to sleep for 11 seconds 00000100:00100000:2.0:1787574425.524815:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290134656 00000100:00100000:2.0:1787574425.524830:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290134656 00000100:00100000:2.0:1787574425.524893:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787574425.524904:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d01b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:14321:x1874407290134656:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787574425.524929:0:14316:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787574425.524948:0:14316:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787574425.524952:0:14316:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787574425.525105:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d01b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:14321:x1874407290134656:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 202us (1597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574425.525119:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787574425.526597:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290134656:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787574425.526679:0:14321:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787574425.526702:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a16143800/0xfe91058e646c087e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0885 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574425.526716:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a16143800/0xfe91058e646c087e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0885 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574425.781201:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787574426.161424:0:14357:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787574426.161432:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787574426.162036:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787574426.162101:0:14357:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787574426.162131:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:3.0:1787574426.805815:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574427.831251:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787574428.168886:0:14605:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787574428.851554:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787574429.297752:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574429.297759:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574429.297762:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574429.297765:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574429.297768:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787574429.297785:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787574429.297789:0:38:0:(import.c:65:import_set_state_nolock()) ffff982a2e0dd000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574429.297802:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff982a2e0dd000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1787574429.297830:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982a3a8ab480 x1874407290134912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787574429.297869:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574429.297898:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2841886-4ae8-43da-bc7c-46b9b13f805e:3300:1874407290134784:0@lo:400:kworker.0 00000100:00100000:1.0:1787574429.297984:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874407290134912:0@lo:38:kworker.0 00000100:00100000:1.0:1787574429.298088:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574429.298148:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290134912 00000100:00100000:3.0:1787574429.298158:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290134912 00000100:00100000:3.0:1787574429.298252:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787574429.298260:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1874407290134912:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787574429.298285:0:14326:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 405 last 0 00000100:00100000:0.0:1787574429.298313:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1787574429.298334:0:14326:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xfe91058e646c088c 00000004:00100000:3.0:1787574429.298354:0:14326:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1787574429.298369:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290134784 00000100:00100000:0.0:1787574429.298378:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290134784 00000100:00100000:0.0:1787574429.298443:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787574429.298457:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d01bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:3300:x1874407290134784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574429.298535:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d01bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:3300:x1874407290134784:12345-0@lo:400:kworker.0 Request processed in 80us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574429.298546:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787574429.298577:0:14326:0:(import.c:65:import_set_state_nolock()) ffff982906b89800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574429.298624:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2841886-4ae8-43da-bc7c-46b9b13f805e:3300:1874407290134784:0@lo:400:kworker.0 00000100:00100000:3.0:1787574429.301489:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874407290134912:12345-0@lo:38:kworker.0 Request processed in 3220us (3393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574429.301503:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787574429.305300:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff982a3a8ab480 x1874407290134912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787574429.305328:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787574429.305340:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787574429.305347:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787574429.305351:0:3297:0:(import.c:65:import_set_state_nolock()) ffff982a2e0dd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787574429.305359:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874407290134912:0@lo:38:kworker.0 00010000:00010000:3.0:1787574429.878692:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574430.898378:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787574430.951529:0:14757:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe95c84650 20000000:00000080:2.0:1787574430.951546:0:14757:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff982a3a662000 uarg=0000000000000000 20000000:01000000:2.0:1787574430.951590:0:14757:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787574430.951598:0:14757:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787574430.951602:0:14757:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787574430.952453:0:14758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787574430.952617:0:14757:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787574430.958583:0:14757:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787574430.958618:0:14757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982a069fa800/0xfe91058e646c0893 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574430.958636:0:14757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a057e1600/0xfe91058e646c0854 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c084d expref: 11 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574430.958644:0:14757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982a069fa800/0xfe91058e646c0893 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574430.958688:0:14757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a057e1600/0xfe91058e646c0854 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646c084d expref: 11 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574430.958704:0:14757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982a057e1600/0xfe91058e646c0854 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646c084d expref: 11 pid: 14319 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574430.958717:0:14757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14757:1874407290135040:0@lo:104: 00000100:00100000:2.0:1787574430.958780:0:14757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574430.958877:0:14757:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a03d54e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574430.958941:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290135040 00000100:00100000:3.0:1787574430.958949:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290135040 00000100:00100000:3.0:1787574430.959040:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787574430.959051:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b2841886-4ae8-43da-bc7c-46b9b13f805e+3:14757:x1874407290135040:12345-0@lo:104: 00010000:00010000:3.0:1787574430.959064:0:14308:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c084d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646c0854 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574430.959131:0:14308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787574430.959138:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b2841886-4ae8-43da-bc7c-46b9b13f805e+3:14757:x1874407290135040:12345-0@lo:104: Request processed in 90us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574430.959156:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787574430.959249:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574430.959257:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c084d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646c0854 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574430.959276:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fb800 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:0.0:1787574430.959281:0:14313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c084d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646c0854 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574430.959290:0:14313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c084d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646c0854 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574430.959298:0:14313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c084d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646c0854 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574430.959305:0:14313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787574430.959337:0:14313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c084d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646c0854 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574430.959344:0:14313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574430.959362:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c084d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646c0854 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574430.959369:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c084d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646c0854 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574430.959384:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574430.959386:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574430.959387:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574430.959409:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2841886-4ae8-43da-bc7c-46b9b13f805e:3298:1874407290135168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574430.959440:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574430.959495:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290135168 00000100:00100000:0.0:1787574430.959500:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290135168 00010000:00010000:0.0:1787574430.959516:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a057e1600/0xfe91058e646c0854 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646c084d expref: 12 pid: 14319 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574430.959544:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574430.959563:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:3298:x1874407290135168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787574430.959575:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574430.959580:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a057e1600/0xfe91058e646c0854 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646c084d expref: 12 pid: 14319 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574430.959590:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a057e1600/0xfe91058e646c0854 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646c084d expref: 12 pid: 14319 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574430.959606:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982a069fa800/0xfe91058e646c0893 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574430.959614:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a069fa800/0xfe91058e646c0893 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574430.959628:0:14310:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a069fa800/0xfe91058e646c0893 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574430.959635:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a069fa800/0xfe91058e646c0893 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574430.959642:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982a069fa800/0xfe91058e646c0893 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574430.959648:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982a069fa800/0xfe91058e646c0893 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574430.959654:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fa800 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574430.959658:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982a069fa800/0xfe91058e646c0893 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574430.959672:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982a069fa800/0xfe91058e646c0893 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574430.959681:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982a069fa800/0xfe91058e646c0893 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574430.959690:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574430.959719:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:3298:x1874407290135168:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574430.959726:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574430.959762:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2841886-4ae8-43da-bc7c-46b9b13f805e:3298:1874407290135168:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574430.959868:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a057e1600/0xfe91058e646c0854 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646c084d expref: 11 pid: 14319 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574430.959890:0:14757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14757:1874407290135040:0@lo:104: 00010000:00010000:2.0:1787574430.959905:0:14757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982a069fa800/0xfe91058e646c0893 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574430.959914:0:14757:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982a069fa800/0xfe91058e646c0893 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574430.959921:0:14757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982a069fa800/0xfe91058e646c0893 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574430.959928:0:14757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a069fa800/0xfe91058e646c0893 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574431.925082:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574432.948012:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787574432.955180:0:14321:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787574432.955188:0:14321:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982905b62800 from 10 10000000:01000000:3.0:1787574432.955193:0:14321:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787574432.955238:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a16142600/0xfe91058e646c089a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574432.955250:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a16142600/0xfe91058e646c089a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574432.955262:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a16142600/0xfe91058e646c089a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574432.955287:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290135296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787574432.955354:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574432.955401:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0dd0e240 going to sleep for 11 seconds 00000100:00100000:2.0:1787574432.955601:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290135296 00000100:00100000:2.0:1787574432.955610:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290135296 00000100:00100000:2.0:1787574432.955664:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787574432.955675:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+11:14321:x1874407290135296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574432.955688:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574432.955702:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a069fa000/0xfe91058e646c08a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646c089a expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574432.955724:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a069fa000/0xfe91058e646c08a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646c089a expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574432.955733:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a069fa000/0xfe91058e646c08a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c089a expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574432.955742:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fa000, rc 0) 00000100:00100000:2.0:1787574432.955798:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:14321:x1874407290135296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574432.955806:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787574432.956016:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290135296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574432.956032:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a16142600/0xfe91058e646c089a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c08a1 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574432.956041:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a16142600/0xfe91058e646c089a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646c08a1 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574432.956094:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290135424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574432.956122:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574432.956145:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0dd0e240 going to sleep for 11 seconds 00000100:00100000:0.0:1787574432.956250:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290135424 00000100:00100000:0.0:1787574432.956255:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290135424 00000100:00100000:0.0:1787574432.956279:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787574432.956288:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d01a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:14321:x1874407290135424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574432.956526:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d01a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:14321:x1874407290135424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574432.956533:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787574432.956579:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290135424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574432.956607:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290135552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574432.956644:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574432.956664:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0805f240 going to sleep for 11 seconds 00000100:00100000:2.0:1787574432.956689:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290135552 00000100:00100000:2.0:1787574432.956694:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290135552 00000100:00100000:2.0:1787574432.956720:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787574432.957297:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:14321:x1874407290135552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574432.957454:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:14321:x1874407290135552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 726us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574432.958030:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290135552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574432.959605:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000040:00080000:3.0:1787574432.967129:0:14870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787574432.968134:0:14321:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787574432.968201:0:14321:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787574432.968214:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a16142600/0xfe91058e646c089a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c08a1 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574432.968226:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a16142600/0xfe91058e646c089a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c08a1 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574433.973088:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787574434.417897:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574434.417906:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574434.417909:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574434.417912:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787574434.417960:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2841886-4ae8-43da-bc7c-46b9b13f805e:3299:1874407290135680:0@lo:400:kworker.0 00000100:00100000:3.0:1787574434.418053:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574434.418144:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874407290135808:0@lo:400:kworker.0 00000100:00100000:3.0:1787574434.419261:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574434.419685:0:3297:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574424/real 1787574424] req@ffff982a419a1500 x1874407290132224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574434 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574434.419716:0:3297:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff982a419a1500 x1874407290132224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574434 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574434.419727:0:3297:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574424/real 1787574424] req@ffff982a3a8aad80 x1874407290132096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574434 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574434.419740:0:3297:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff982a3a8aad80 x1874407290132096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574434 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787574434.419755:0:3297:0:(import.c:65:import_set_state_nolock()) ffff982a40f8f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574434.419777:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787574434.419781:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874407290132224:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787574434.419788:0:3297:0:(import.c:65:import_set_state_nolock()) ffff982a0814b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574434.419794:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787574434.419797:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874407290132096:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787574434.419957:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290135680 00000100:00100000:3.0:1787574434.420015:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290135680 00000100:00100000:3.0:1787574434.420088:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787574434.420101:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d01b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:3299:x1874407290135680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574434.420400:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d01b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:3299:x1874407290135680:12345-0@lo:400:kworker.0 Request processed in 230us (2275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574434.420409:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787574434.420555:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290135808 00000100:00100000:3.0:1787574434.420560:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290135808 00000100:00100000:3.0:1787574434.420592:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787574434.420598:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874407290135808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574434.420637:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874407290135808:12345-0@lo:400:kworker.0 Request processed in 39us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574434.420643:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787574434.420672:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574434.420676:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787574434.420690:0:467:0:(import.c:65:import_set_state_nolock()) ffff982a0814b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574434.420694:0:467:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 400 00000100:00080000:3.0:1787574434.420698:0:467:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787574434.420702:0:467:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff982a0814b000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1787574434.420729:0:467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982a3a8aaa00 x1874407290135936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787574434.420748:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574434.420751:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787574434.420752:0:467:0:(import.c:65:import_set_state_nolock()) ffff982a40f8f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574434.420755:0:467:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 400 00000100:00080000:3.0:1787574434.420757:0:467:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787574434.420760:0:467:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff982a40f8f800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1787574434.420771:0:467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982a3a8a8a80 x1874407290136064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574434.420794:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874407290135936:0@lo:8:kworker.0 00000400:00000100:3.0:1787574434.420824:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407290135936 offset 0 length 520: 4 00000100:00100000:3.0:1787574434.420850:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874407290136064:0@lo:8:kworker.0 00000400:00000100:3.0:1787574434.420942:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407290136064 offset 0 length 520: 4 00000100:00100000:3.0:1787574434.421283:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2841886-4ae8-43da-bc7c-46b9b13f805e:3299:1874407290135680:0@lo:400:kworker.0 00010000:00080000:3.0:1787574434.421322:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff982a3a8a8000 x1874407290135808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574434.421584:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874407290135808:0@lo:400:kworker.0 00010000:00010000:3.0:1787574434.998046:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787574435.192156:0:15005:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787574435.192160:0:15005:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787574435.192290:0:15005:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff982a03510800 00000020:01000004:3.0:1787574435.192305:0:15005:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787574435.192316:0:15005:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787574435.192329:0:15005:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff982a04888000) 00000020:00000080:3.0:1787574435.192344:0:15005:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787574435.215338:0:15005:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787574435.215626:0:15005:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787574435.216461:0:15005:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787574435.216717:0:15005:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787574435.217208:0:15005:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787574435.217571:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 439: rc = 0 00100000:10000000:2.0:1787574435.217704:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 439: rc = 0 00100000:10000000:2.0:1787574435.217791:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 439: rc = 0 00100000:10000000:2.0:1787574435.218331:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 322: rc = 0 00100000:10000000:2.0:1787574435.218678:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 322: rc = 0 00100000:10000000:2.0:1787574435.218932:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 322: rc = 0 00100000:10000000:2.0:1787574435.219261:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 322: rc = 0 00100000:10000000:2.0:1787574435.220360:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 322: rc = 0 00100000:10000000:2.0:1787574435.220641:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 322: rc = 0 00000020:00000080:2.0:1787574435.226539:0:15005:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787574435.226552:0:15005:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787574435.226563:0:15005:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xfe91058e646c08af 00000020:01000004:2.0:1787574435.226572:0:15005:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787574435.226592:0:15005:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787574435.226595:0:15005:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787574435.226601:0:15005:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787574435.226605:0:15005:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787574435.226628:0:15005:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff982a04770000) 00000020:00000080:2.0:1787574435.226640:0:15005:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787574435.227741:0:15005:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787574435.227904:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787574435.227910:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787574435.231548:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787574435.231559:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787574435.231844:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787574435.231855:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787574435.233123:0:15005:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574435.233309:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787574435.233315:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787574435.235570:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787574435.235927:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787574435.252917:0:15005:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787574435.253159:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787574435.253649:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787574435.256151:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787574435.256230:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787574435.257074:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787574435.257084:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787574435.259555:0:15005:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787574435.259727:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787574435.259734:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787574435.260870:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787574435.260878:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787574435.345919:0:15005:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787574435.346117:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787574435.346125:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787574435.347728:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787574435.347739:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787574435.348603:0:15005:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787574435.348627:0:15005:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787574435.348633:0:15005:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787574435.365837:0:15005:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787574435.365884:0:15005:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787574435.365889:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787574435.365891:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787574435.365892:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787574435.365893:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787574435.365895:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787574435.365896:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787574435.365897:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787574435.365899:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787574435.365901:0:15005:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787574435.365904:0:15005:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787574435.365906:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787574435.365907:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787574435.365908:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787574435.365909:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787574435.365910:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787574435.365911:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787574435.365912:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787574435.365914:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787574435.365915:0:15005:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787574435.365938:0:15005:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787574435.365956:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290136192:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787574435.366200:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574435.367149:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0805f780 going to sleep for 11 seconds 00000100:00100000:2.0:1787574435.368061:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290136192 00000100:00100000:2.0:1787574435.368071:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290136192 00000100:00100000:2.0:1787574435.368133:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787574435.368143:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d019050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:15005:x1874407290136192:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787574435.368335:0:14319:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787574435.368339:0:14319:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787574435.368343:0:14319:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787574435.386052:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d019050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:15005:x1874407290136192:12345-0@lo:253:mount.lustre.0 Request processed in 17902us (19843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574435.386066:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787574435.386444:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290136192:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787574435.386458:0:15005:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787574435.386461:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787574435.386463:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787574435.386464:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787574435.386465:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787574435.386467:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787574435.386481:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787574435.386482:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787574435.386484:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787574435.386486:0:15005:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787574435.386502:0:15005:0:(tgt_mount.c:101:server_register_mount()) register mount ffff982a03510800 from lustre-OST0000 10000000:01000000:1.0:1787574435.386525:0:15005:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787574435.386539:0:15005:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787574435.386546:0:15005:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff982a03e93370 local copy 00010000:00010000:1.0:1787574435.386557:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a069fbc00/0xfe91058e646c07a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c07ac expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574435.387020:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290136320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574435.387064:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574435.387095:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0805f240 going to sleep for 11 seconds 00000100:00100000:3.0:1787574435.387191:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290136320 00000100:00100000:3.0:1787574435.387264:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290136320 00000100:00100000:3.0:1787574435.387344:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787574435.387354:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:15005:x1874407290136320:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574435.387516:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:15005:x1874407290136320:12345-0@lo:501:mount.lustre.0 Request processed in 163us (450us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787574435.387524:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787574435.387600:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290136320:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787574435.387614:0:15005:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787574435.387758:0:15005:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787574435.387765:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a069fbc00/0xfe91058e646c07a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c07ac expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574435.387775:0:15005:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a069fbc00/0xfe91058e646c07a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c07ac expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574435.387794:0:15005:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff982a03510800 10000000:01000000:1.0:1787574435.387799:0:15005:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787574435.387803:0:15005:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff982a03e93370 10000000:01000000:1.0:1787574435.387805:0:15005:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787574435.387809:0:15005:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff982a03e93370 from 1 10000000:01000000:1.0:1787574435.387811:0:15005:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787574435.387833:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a057e1600/0xfe91058e646c08bd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574435.387847:0:15005:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a057e1600/0xfe91058e646c08bd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574435.387857:0:15005:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a057e1600/0xfe91058e646c08bd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574435.387870:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290136448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787574435.387898:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574435.388106:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0805f240 going to sleep for 11 seconds 00000100:00100000:0.0:1787574435.388443:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290136448 00000100:00100000:0.0:1787574435.388458:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290136448 00000100:00100000:0.0:1787574435.388486:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787574435.388492:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+12:15005:x1874407290136448:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574435.388501:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574435.388514:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a41d00400/0xfe91058e646c08c4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646c08bd expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574435.388545:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a41d00400/0xfe91058e646c08c4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646c08bd expref: 13 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574435.388554:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a41d00400/0xfe91058e646c08c4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c08bd expref: 13 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574435.388561:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a41d00400, rc 0) 00000100:00100000:0.0:1787574435.388605:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+13:15005:x1874407290136448:12345-0@lo:101:mount.lustre.0 Request processed in 112us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.388611:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787574435.388696:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290136448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574435.388710:0:15005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a057e1600/0xfe91058e646c08bd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c08c4 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574435.388719:0:15005:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a057e1600/0xfe91058e646c08bd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646c08c4 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574435.388734:0:15005:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787574435.388753:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a057e1600/0xfe91058e646c08bd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c08c4 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574435.388760:0:15005:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a057e1600/0xfe91058e646c08bd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c08c4 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574435.388766:0:15005:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787574435.388771:0:15005:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787574435.388775:0:15005:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787574435.388777:0:15005:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787574435.388798:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a057e0200/0xfe91058e646c08cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574435.388805:0:15005:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a057e0200/0xfe91058e646c08cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574435.388813:0:15005:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a057e0200/0xfe91058e646c08cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574435.388827:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290136576:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787574435.388858:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574435.388877:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0805f240 going to sleep for 11 seconds 00000100:00100000:3.0:1787574435.388932:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290136576 00000100:00100000:3.0:1787574435.388936:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290136576 00000100:00100000:3.0:1787574435.388958:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787574435.388965:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+13:15005:x1874407290136576:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574435.388972:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574435.388988:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a16142000/0xfe91058e646c08d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646c08cb expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574435.389004:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a16142000/0xfe91058e646c08d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646c08cb expref: 14 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574435.389012:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a16142000/0xfe91058e646c08d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c08cb expref: 14 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574435.389020:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a16142000, rc 0) 00000100:00100000:3.0:1787574435.389060:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+14:15005:x1874407290136576:12345-0@lo:101:mount.lustre.0 Request processed in 96us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574435.389067:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787574435.389151:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290136576:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574435.389161:0:15005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a057e0200/0xfe91058e646c08cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c08d2 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574435.389182:0:15005:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a057e0200/0xfe91058e646c08cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646c08d2 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787574435.389777:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787574435.390639:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574435.390884:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787574435.390929:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787574435.390961:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787574435.391010:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787574435.391050:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787574435.391083:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787574435.391147:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787574435.391154:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787574435.391258:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290136704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574435.391320:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574435.391351:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0805f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787574435.391710:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290136704 00000100:00100000:2.0:1787574435.391717:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290136704 00000100:00100000:2.0:1787574435.391764:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787574435.391774:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+14:15005:x1874407290136704:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574435.392106:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+14:15005:x1874407290136704:12345-0@lo:501:mount.lustre.0 Request processed in 333us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574435.392114:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787574435.392600:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290136704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574435.392637:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290136832:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787574435.392680:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574435.392748:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0805f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787574435.392781:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290136832 00000100:00100000:2.0:1787574435.392786:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290136832 00000100:00100000:2.0:1787574435.392860:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787574435.392869:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+14:15005:x1874407290136832:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787574435.393189:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+14:15005:x1874407290136832:12345-0@lo:503:mount.lustre.0 Request processed in 320us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574435.393206:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787574435.393296:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290136832:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787574435.393723:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787574435.393778:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290136960:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787574435.393818:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574435.394247:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0805f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787574435.394524:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290136960 00000100:00100000:3.0:1787574435.394542:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290136960 00000100:00100000:3.0:1787574435.394574:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787574435.394582:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+14:15005:x1874407290136960:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574435.394789:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+14:15005:x1874407290136960:12345-0@lo:502:mount.lustre.0 Request processed in 207us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574435.394797:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787574435.394885:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290136960:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787574435.395127:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787574435.395225:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787574435.395281:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787574435.395334:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787574435.395372:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787574435.395407:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787574435.395469:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787574435.395506:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787574435.395551:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787574435.395598:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787574435.395635:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787574435.395683:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787574435.395719:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290137088:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787574435.395767:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574435.395808:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0805f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787574435.397043:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290137088 00000100:00100000:2.0:1787574435.397064:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290137088 00000100:00100000:1.0:1787574435.397436:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787574435.397446:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+14:15005:x1874407290137088:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787574435.397684:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+14:15005:x1874407290137088:12345-0@lo:502:mount.lustre.0 Request processed in 239us (1915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574435.397692:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787574435.397835:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290137088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787574435.397937:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787574435.397951:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1787574435.402738:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787574435.402749:0:15019:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787574435.402755:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574435.402757:0:15019:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787574435.402762:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787574435.402779:0:15019:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff982a2bca99b8) 00000020:00000080:3.0:1787574435.402804:0:15019:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787574435.402810:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787574435.403078:0:15019:0:(tgt_mount.c:153:server_get_mount()) get mount ffff982a03510800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787574435.403089:0:15019:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787574435.403102:0:15019:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xfe91058e646c08e0 00010000:00010000:3.0:1787574435.408772:0:15019:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1787574435.409577:0:15019:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1787574435.414605:0:15019:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787574435.416295:0:15019:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787574435.416307:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574435.416313:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574435.416315:0:15019:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787574435.416319:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787574435.416322:0:15019:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1787574435.416323:0:15019:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787574435.416325:0:15019:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787574435.416327:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787574435.416329:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574435.416331:0:15019:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787574435.416333:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574435.416336:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574435.416338:0:15019:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787574435.416340:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787574435.416342:0:15019:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787574435.416344:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574435.416346:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574435.416348:0:15019:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787574435.416350:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574435.416352:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574435.416353:0:15019:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787574435.416356:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787574435.416440:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574435.416444:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574435.416446:0:15019:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787574435.416449:0:15019:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787574435.416561:0:15005:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787574435.416585:0:15005:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787574435.416607:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a057e0200/0xfe91058e646c08cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c08d2 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574435.416618:0:15005:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a057e0200/0xfe91058e646c08cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c08d2 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574435.416626:0:15005:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982a03510800 from 1 10000000:01000000:2.0:1787574435.416754:0:15005:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787574435.416798:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c08e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574435.416806:0:15005:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c08e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574435.416817:0:15005:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c08e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574435.416840:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290137216:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787574435.416902:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574435.416939:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a41233900 going to sleep for 11 seconds 00000100:00100000:1.0:1787574435.416940:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290137216 00000100:00100000:1.0:1787574435.416947:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290137216 00000100:00100000:1.0:1787574435.417098:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787574435.417108:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+14:15005:x1874407290137216:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574435.417120:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574435.417132:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a057e0e00/0xfe91058e646c08ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646c08e7 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574435.417152:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a057e0e00/0xfe91058e646c08ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646c08e7 expref: 15 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574435.417191:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a057e0e00/0xfe91058e646c08ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c08e7 expref: 15 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574435.417201:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0e00, rc 0) 00000100:00100000:1.0:1787574435.417242:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+15:15005:x1874407290137216:12345-0@lo:101:mount.lustre.0 Request processed in 136us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574435.417248:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787574435.417468:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290137216:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574435.417483:0:15005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c08e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c08ee expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574435.417491:0:15005:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c08e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646c08ee expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787574435.418032:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787574435.419940:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787574435.420759:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787574435.420880:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787574435.420949:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787574435.420964:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787574435.421052:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290137344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787574435.421116:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574435.422364:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a02e2d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574435.425352:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290137344 00000100:00100000:1.0:1787574435.425365:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290137344 00000100:00100000:1.0:1787574435.425462:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787574435.425472:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+15:15005:x1874407290137344:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574435.425756:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+15:15005:x1874407290137344:12345-0@lo:501:mount.lustre.0 Request processed in 285us (4639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574435.425774:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787574435.425864:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290137344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574435.425914:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290137472:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787574435.425967:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574435.428601:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04fb1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574435.429501:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290137472 00000100:00100000:0.0:1787574435.429512:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290137472 00000100:00100000:0.0:1787574435.429571:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787574435.429580:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+15:15005:x1874407290137472:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787574435.430584:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+15:15005:x1874407290137472:12345-0@lo:503:mount.lustre.0 Request processed in 1000us (4612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.430593:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787574435.431577:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290137472:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787574435.432604:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787574435.432777:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290137600:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574435.432852:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574435.432945:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290137600 00000100:00100000:3.0:1787574435.432951:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a011ca540 going to sleep for 11 seconds 00000100:00100000:0.0:1787574435.432953:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290137600 00000100:00100000:0.0:1787574435.433026:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787574435.433036:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06997850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+15:15005:x1874407290137600:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574435.433399:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06997850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+15:15005:x1874407290137600:12345-0@lo:502:mount.lustre.0 Request processed in 364us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574435.433469:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290137600:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574435.433558:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000040:00080000:3.0:1787574435.433705:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787574435.433761:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787574435.433827:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787574435.433874:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787574435.433909:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787574435.434047:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787574435.434091:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787574435.434125:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787574435.434155:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290137728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574435.434238:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574435.434265:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a011ca540 going to sleep for 11 seconds 00000100:00100000:0.0:1787574435.434323:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290137728 00000100:00100000:0.0:1787574435.434329:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290137728 00000100:00100000:0.0:1787574435.434359:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787574435.434560:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+15:15005:x1874407290137728:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574435.434749:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+15:15005:x1874407290137728:12345-0@lo:502:mount.lustre.0 Request processed in 382us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.434756:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787574435.434824:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290137728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787574435.434898:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787574435.434908:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787574435.435796:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574435.435806:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574435.435808:0:15023:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787574435.435814:0:15023:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982a03510800 00000020:00000080:1.0:1787574435.435823:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787574435.435831:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574435.435834:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574435.435836:0:15023:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787574435.435838:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574435.435840:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574435.435842:0:15023:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787574435.435845:0:15023:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982a03510800 00000020:00000080:1.0:1787574435.435846:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787574435.435935:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574435.435939:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574435.435940:0:15023:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787574435.435943:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574435.435946:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574435.435947:0:15023:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787574435.435950:0:15023:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff982a03510800 00000020:00000080:1.0:1787574435.435952:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787574435.436318:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574435.436323:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574435.436324:0:15023:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787574435.436327:0:15023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787574435.441599:0:15005:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787574435.441645:0:15005:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787574435.441673:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c08e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c08ee expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574435.441701:0:15005:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c08e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c08ee expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574435.441750:0:15005:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787574435.441753:0:15005:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff982a03510800 10000000:01000000:3.0:1787574435.441756:0:15005:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff982a03510800 10000000:01000000:3.0:1787574435.441759:0:15005:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787574435.441765:0:15005:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982a03510800 from 1 10000000:01000000:3.0:1787574435.441767:0:15005:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787574435.441805:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a16142200/0xfe91058e646c08f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574435.441813:0:15005:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a16142200/0xfe91058e646c08f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574435.441823:0:15005:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a16142200/0xfe91058e646c08f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574435.441846:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290137856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787574435.441910:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574435.441948:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a011ca240 going to sleep for 11 seconds 00000100:00100000:0.0:1787574435.442050:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290137856 00000100:00100000:0.0:1787574435.442058:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290137856 00000100:00100000:0.0:1787574435.442112:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787574435.442121:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+15:15005:x1874407290137856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574435.442134:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574435.442147:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a41d00600/0xfe91058e646c08fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646c08f5 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574435.442209:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a41d00600/0xfe91058e646c08fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646c08f5 expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574435.442220:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a41d00600/0xfe91058e646c08fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c08f5 expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574435.442228:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a41d00600, rc 0) 00000100:00100000:0.0:1787574435.442281:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:15005:x1874407290137856:12345-0@lo:101:mount.lustre.0 Request processed in 161us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.442288:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787574435.442436:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290137856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574435.442450:0:15005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a16142200/0xfe91058e646c08f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c08fc expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574435.442459:0:15005:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a16142200/0xfe91058e646c08f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646c08fc expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787574435.443130:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1787574435.443464:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787574435.443721:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787574435.443762:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787574435.443794:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787574435.443836:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787574435.443869:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787574435.443909:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787574435.443958:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787574435.443992:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787574435.444039:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787574435.444073:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787574435.444114:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787574435.444189:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787574435.444232:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787574435.444266:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787574435.444316:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787574435.444352:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787574435.444385:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787574435.444432:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787574435.444469:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787574435.444504:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787574435.444578:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787574435.448554:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787574435.449002:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787574435.449086:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787574435.449135:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787574435.451279:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787574435.451378:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787574435.451420:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787574435.451510:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787574435.451536:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1787574435.451637:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290137984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574435.451703:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574435.451743:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a011ca240 going to sleep for 11 seconds 00000100:00100000:2.0:1787574435.455839:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290137984 00000100:00100000:2.0:1787574435.455852:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290137984 00000100:00100000:2.0:1787574435.455948:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787574435.455958:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06995450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:15005:x1874407290137984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574435.456754:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06995450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:15005:x1874407290137984:12345-0@lo:501:mount.lustre.0 Request processed in 794us (5046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574435.456762:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787574435.456840:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290137984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574435.456884:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290138112:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787574435.458183:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574435.458275:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0805fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574435.458677:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290138112 00000100:00100000:0.0:1787574435.458684:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290138112 00000100:00100000:0.0:1787574435.458741:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787574435.458751:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:15005:x1874407290138112:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787574435.458942:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:15005:x1874407290138112:12345-0@lo:503:mount.lustre.0 Request processed in 192us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.458950:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787574435.459343:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290138112:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787574435.459927:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787574435.460014:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290138240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787574435.460068:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574435.460112:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0805fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574435.460133:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290138240 00000100:00100000:2.0:1787574435.460140:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290138240 00000100:00100000:2.0:1787574435.460192:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787574435.460583:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:15005:x1874407290138240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574435.460780:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:15005:x1874407290138240:12345-0@lo:502:mount.lustre.0 Request processed in 201us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574435.460788:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787574435.460998:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290138240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787574435.461946:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787574435.462016:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787574435.462056:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787574435.462121:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787574435.462435:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787574435.462491:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787574435.462524:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787574435.462571:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787574435.462624:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787574435.462846:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787574435.462897:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787574435.463429:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787574435.463475:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787574435.463509:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787574435.463575:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787574435.463824:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787574435.463870:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787574435.463934:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787574435.463976:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787574435.464011:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787574435.464071:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787574435.464110:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787574435.464356:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787574435.464433:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787574435.464476:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787574435.464515:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787574435.464582:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787574435.464621:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787574435.464850:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787574435.464920:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787574435.464974:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787574435.465057:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787574435.465121:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787574435.465950:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787574435.466034:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787574435.466086:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787574435.466145:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787574435.466484:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787574435.466575:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787574435.466624:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787574435.466888:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290138368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787574435.466966:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574435.467016:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0805fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574435.467120:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290138368 00000100:00100000:2.0:1787574435.467128:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290138368 00000100:00100000:3.0:1787574435.469048:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787574435.469068:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06994850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:15005:x1874407290138368:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574435.469573:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06994850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:15005:x1874407290138368:12345-0@lo:502:mount.lustre.0 Request processed in 509us (2606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574435.469582:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787574435.469692:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290138368:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787574435.469814:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787574435.469831:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787574435.473432:0:15028:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787574435.473450:0:15028:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff982a03e90000) 00000020:00000080:1.0:1787574435.473471:0:15028:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787574435.473566:0:15028:0:(tgt_mount.c:153:server_get_mount()) get mount ffff982a03510800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787574435.473571:0:15028:0:(tgt_mount.c:187:server_put_mount()) put mount ffff982a03510800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787574435.473573:0:15028:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982a03510800 3 00010000:00080000:1.0:1787574435.473602:0:15028:0:(ldlm_lib.c:102:import_set_conn()) imp ffff982a3d029800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.151@tcp at head 00010000:00010000:0.0:1787574435.477039:0:15028:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787574435.477612:0:15028:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787574435.477654:0:15028:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787574435.477669:0:15028:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xfe91058e646c090a 00000100:00080000:0.0:1787574435.477680:0:15028:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787574435.477697:0:15028:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff982a3d029800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1787574435.477729:0:15028:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982a3adf0e00 x1874407290138496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787574435.477760:0:15028:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787574435.477877:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1874407290138496:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787574435.477948:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574435.480236:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290138496 00000100:00100000:0.0:1787574435.480249:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290138496 00000100:00100000:0.0:1787574435.480290:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787574435.480299:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1874407290138496:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787574435.480326:0:14326:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:0.0:1787574435.480367:0:14326:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xfe91058e646c0911 00000004:00100000:0.0:1787574435.480385:0:14326:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787574435.480422:0:14326:0:(import.c:65:import_set_state_nolock()) ffff982a03573000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574435.480506:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874407290138496:12345-0@lo:38:llog_process_th.0 Request processed in 206us (2556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.480513:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787574435.480575:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff982a3adf0e00 x1874407290138496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574435.480595:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787574435.480602:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787574435.480609:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787574435.480614:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787574435.480616:0:3297:0:(import.c:65:import_set_state_nolock()) ffff982a3d029800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787574435.480622:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1874407290138496:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787574435.484299:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787574435.484308:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787574435.484311:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787574435.484314:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787574435.484537:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874407290138624:0@lo:400:kworker.0 00000100:00100000:1.0:1787574435.484603:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574435.484786:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290138624 00000100:00100000:3.0:1787574435.484796:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290138624 00000100:00100000:3.0:1787574435.484849:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787574435.484859:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874407290138624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574435.484924:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874407290138624:12345-0@lo:400:kworker.0 Request processed in 67us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574435.484932:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787574435.486028:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff982a419a3b80 x1874407290138624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574435.486059:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874407290138624:0@lo:400:kworker.0 00000040:00080000:2.0:1787574435.487597:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787574435.487738:0:15005:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787574435.487764:0:15005:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787574435.487789:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a16142200/0xfe91058e646c08f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c08fc expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574435.487799:0:15005:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a16142200/0xfe91058e646c08f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c08fc expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787574435.487843:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787574435.487845:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787574435.487846:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787574435.487847:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787574435.487848:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787574435.487850:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787574435.487851:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787574435.487853:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787574435.487855:0:15005:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787574435.487858:0:15005:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787574435.487861:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787574435.487862:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787574435.487863:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787574435.487864:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787574435.487865:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787574435.487866:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787574435.487867:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787574435.487867:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787574435.487869:0:15005:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787574435.487905:0:15005:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787574435.487924:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290138752:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787574435.487986:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574435.488026:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0805f540 going to sleep for 11 seconds 00000100:00100000:2.0:1787574435.488127:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290138752 00000100:00100000:2.0:1787574435.488135:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290138752 00000100:00100000:2.0:1787574435.488270:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787574435.488289:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:15005:x1874407290138752:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787574435.488327:0:14316:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787574435.488340:0:14316:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787574435.518715:0:14316:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787574435.518735:0:14316:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787574435.518799:0:14340:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787574435.518804:0:14340:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787574435.518827:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982a027f2e00/0xfe91058e646c0918 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574435.518845:0:14340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a069fac00/0xfe91058e646c0885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c087e expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574435.518854:0:14340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982a027f2e00/0xfe91058e646c0918 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574435.518898:0:14340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a069fac00/0xfe91058e646c0885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646c087e expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574435.518930:0:14340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982a069fac00/0xfe91058e646c0885 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646c087e expref: 16 pid: 14318 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574435.518945:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8ab800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14340:1874407290138880:0@lo:104: 00000100:00100000:3.0:1787574435.519012:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574435.519061:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04f70300 going to sleep for 11 seconds 00000100:00100000:2.0:1787574435.519127:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290138880 00000100:00100000:2.0:1787574435.519134:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290138880 00000100:00100000:2.0:1787574435.519212:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787574435.519221:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2841886-4ae8-43da-bc7c-46b9b13f805e+3:14340:x1874407290138880:12345-0@lo:104: 00010000:00010000:2.0:1787574435.519234:0:14307:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a16143800/0xfe91058e646c087e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646c0885 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574435.519286:0:14307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787574435.519292:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2841886-4ae8-43da-bc7c-46b9b13f805e+3:14340:x1874407290138880:12345-0@lo:104: Request processed in 72us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574435.519298:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787574435.519319:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574435.519324:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a16143800/0xfe91058e646c087e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646c0885 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574435.519331:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16143800 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:2.0:1787574435.519335:0:14312:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a16143800/0xfe91058e646c087e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646c0885 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574435.519343:0:14312:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a16143800/0xfe91058e646c087e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646c0885 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574435.519349:0:14312:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a16143800/0xfe91058e646c087e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646c0885 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574435.519366:0:14312:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787574435.519394:0:14312:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a16143800/0xfe91058e646c087e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646c0885 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574435.519401:0:14312:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787574435.519568:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a16143800/0xfe91058e646c087e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646c0885 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574435.519576:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a16143800/0xfe91058e646c087e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646c0885 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574435.519595:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574435.519597:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574435.519598:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574435.519615:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2841886-4ae8-43da-bc7c-46b9b13f805e:3298:1874407290139008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574435.519646:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574435.519687:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290139008 00000100:00100000:2.0:1787574435.519691:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290139008 00010000:00010000:2.0:1787574435.519709:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a069fac00/0xfe91058e646c0885 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646c087e expref: 17 pid: 14318 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574435.519732:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787574435.519739:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2841886-4ae8-43da-bc7c-46b9b13f805e+17:3298:x1874407290139008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574435.519749:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574435.519753:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a069fac00/0xfe91058e646c0885 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646c087e expref: 17 pid: 14318 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574435.519764:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a069fac00/0xfe91058e646c0885 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646c087e expref: 17 pid: 14318 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574435.519787:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982a027f2e00/0xfe91058e646c0918 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574435.519794:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a027f2e00/0xfe91058e646c0918 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787574435.519805:0:14311:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001893380s 00010000:00010000:2.0:1787574435.519810:0:14311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a027f2e00/0xfe91058e646c0918 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574435.519817:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a027f2e00/0xfe91058e646c0918 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574435.519823:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982a027f2e00/0xfe91058e646c0918 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574435.519830:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982a027f2e00/0xfe91058e646c0918 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574435.519835:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a027f2e00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574435.519839:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982a027f2e00/0xfe91058e646c0918 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574435.519845:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982a027f2e00/0xfe91058e646c0918 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574435.519853:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982a027f2e00/0xfe91058e646c0918 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574435.519861:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574435.519891:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2841886-4ae8-43da-bc7c-46b9b13f805e+17:3298:x1874407290139008:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574435.519905:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787574435.519941:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2841886-4ae8-43da-bc7c-46b9b13f805e:3298:1874407290139008:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574435.519967:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a069fac00/0xfe91058e646c0885 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646c087e expref: 16 pid: 14318 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574435.519977:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8ab800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14340:1874407290138880:0@lo:104: 00010000:00010000:2.0:1787574435.519991:0:14340:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982a027f2e00/0xfe91058e646c0918 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574435.519999:0:14340:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982a027f2e00/0xfe91058e646c0918 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574435.520004:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982a027f2e00/0xfe91058e646c0918 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574435.520010:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a027f2e00/0xfe91058e646c0918 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574435.528607:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+15:15005:x1874407290138752:12345-0@lo:253:mount.lustre.0 Request processed in 40312us (40612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.528640:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787574435.528751:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15005:1874407290138752:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787574435.528767:0:15005:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787574435.528770:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787574435.528772:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787574435.528773:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574435.528774:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574435.528775:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574435.528777:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574435.528778:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787574435.528780:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574435.528781:0:15005:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787574435.528795:0:15005:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787574435.533850:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787574435.534032:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787574435.534375:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787574435.534634:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787574435.534784:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787574435.535021:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787574435.536734:0:15005:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787574435.581796:0:15005:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787574435.581805:0:15005:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787574435.581838:0:15005:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787574435.581888:0:15005:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787574435.581905:0:15005:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787574435.581934:0:15005:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787574436.017316:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787574436.402589:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1787574436.977270:0:14321:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787574436.977293:0:14321:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff982905b62800 from 7 10000000:01000000:1.0:1787574436.977298:0:14321:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787574436.977339:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a057e1a00/0xfe91058e646c091f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574436.977350:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a057e1a00/0xfe91058e646c091f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574436.977362:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a057e1a00/0xfe91058e646c091f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574436.977385:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290139136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787574436.977450:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574436.977531:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a26fc6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574436.977575:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290139136 00000100:00100000:2.0:1787574436.977584:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290139136 00000100:00100000:2.0:1787574436.977632:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787574436.977643:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06995850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+15:14321:x1874407290139136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574436.977666:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574436.977679:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a069fa400/0xfe91058e646c0926 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646c091f expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574436.977702:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a069fa400/0xfe91058e646c0926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646c091f expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574436.977712:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a069fa400/0xfe91058e646c0926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c091f expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574436.977721:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fa400, rc 0) 00000100:00100000:2.0:1787574436.977775:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06995850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:14321:x1874407290139136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574436.977783:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787574436.977939:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290139136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574436.977953:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a057e1a00/0xfe91058e646c091f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0926 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574436.977962:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a057e1a00/0xfe91058e646c091f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646c0926 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574436.978007:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290139264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787574436.978036:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574436.978058:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff98290611b780 going to sleep for 11 seconds 00000100:00100000:1.0:1787574436.978192:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290139264 00000100:00100000:1.0:1787574436.978619:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290139264 00000100:00100000:1.0:1787574436.978659:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787574436.978668:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:14321:x1874407290139264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787574436.978685:0:14319:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787574436.978706:0:14319:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787574436.978709:0:14319:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1787574436.978810:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:14321:x1874407290139264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574436.978817:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787574436.979043:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290139264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787574436.979101:0:14321:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787574436.979110:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a057e1a00/0xfe91058e646c091f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0926 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574436.979124:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a057e1a00/0xfe91058e646c091f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0926 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574437.045399:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574438.065412:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574439.097182:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574440.114406:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787574440.510941:0:15373:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1787574440.562820:0:14219:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574440.562827:0:14219:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574440.562829:0:14219:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574440.562832:0:14219:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787574440.563112:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2841886-4ae8-43da-bc7c-46b9b13f805e:3299:1874407290139392:0@lo:400:kworker.0 00000100:00100000:2.0:1787574440.563198:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574440.563254:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290139392 00000100:00100000:2.0:1787574440.563261:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290139392 00000100:00100000:2.0:1787574440.563300:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787574440.563309:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06994450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:3299:x1874407290139392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574440.563357:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06994450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:3299:x1874407290139392:12345-0@lo:400:kworker.0 Request processed in 49us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574440.563363:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787574440.563549:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2841886-4ae8-43da-bc7c-46b9b13f805e:3299:1874407290139392:0@lo:400:kworker.0 00000100:00100000:1.0:1787574440.563760:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874407290139520:0@lo:400:kworker.0 00000100:00100000:1.0:1787574440.563793:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574440.563816:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574440.563823:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290139648:0@lo:400:kworker.0 00000100:00100000:1.0:1787574440.563846:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574440.563884:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290139520 00000100:00100000:1.0:1787574440.563887:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290139520 00000100:00100000:1.0:1787574440.563912:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290139648 00000100:00100000:1.0:1787574440.563914:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290139648 00000100:00100000:1.0:1787574440.563937:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787574440.563944:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874407290139520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574440.563996:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874407290139520:12345-0@lo:400:kworker.0 Request processed in 52us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574440.564002:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787574440.564015:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787574440.564021:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290139648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574440.564048:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290139648:12345-0@lo:400:kworker.0 Request processed in 27us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574440.564053:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787574440.564082:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a3a8a9880 x1874407290139648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574440.564094:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290139648:0@lo:400:kworker.0 00010000:00080000:1.0:1787574440.564104:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a3a8a9180 x1874407290139520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574440.564112:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874407290139520:0@lo:400:kworker.0 00000100:00080000:1.0:1787574440.565403:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787574441.137663:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574442.164536:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574443.185505:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574444.210492:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574445.233525:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787574445.681301:0:14219:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574445.681308:0:14219:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574445.681310:0:14219:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574445.681313:0:14219:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787574445.681361:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290139904:0@lo:400:kworker.0 00000100:00100000:1.0:1787574445.681361:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290140032:0@lo:400:kworker.0 00000100:00100000:2.0:1787574445.681450:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2841886-4ae8-43da-bc7c-46b9b13f805e:3298:1874407290139776:0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.681505:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574445.681799:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290139904 00000100:00100000:0.0:1787574445.681808:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290139904 00000100:00100000:0.0:1787574445.681852:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787574445.681861:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290139904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.681862:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574445.681892:0:14326:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787574445.681900:0:14326:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787574445.681929:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290139904:12345-0@lo:400:kworker.0 Request processed in 69us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574445.681937:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787574445.681963:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290140032 00000100:00100000:0.0:1787574445.681966:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290140032 00000100:00100000:0.0:1787574445.681993:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787574445.681999:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290140032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574445.683435:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874407290140032:12345-0@lo:400:kworker.0 Request processed in 1429us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574445.683447:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787574445.683497:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574445.683626:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787574445.683678:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a3a8aa300 x1874407290140032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574445.683693:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874407290140032:0@lo:400:kworker.0 00000100:00100000:1.0:1787574445.684058:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290139776 00000100:00100000:1.0:1787574445.684065:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290139776 00000100:00100000:1.0:1787574445.684108:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787574445.684117:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06994050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:3298:x1874407290139776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574445.684209:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06994050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:3298:x1874407290139776:12345-0@lo:400:kworker.0 Request processed in 92us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574445.684216:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787574445.684464:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2841886-4ae8-43da-bc7c-46b9b13f805e:3298:1874407290139776:0@lo:400:kworker.0 00010000:00080000:3.0:1787574445.685252:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a3a8a9f80 x1874407290139904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574445.685266:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290139904:0@lo:400:kworker.0 00010000:00010000:0.0:1787574446.259003:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787574446.602219:0:15726:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787574446.602223:0:15726:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787574446.602342:0:15726:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff982a2e03e000 00000020:01000004:2.0:1787574446.602357:0:15726:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787574446.602370:0:15726:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787574446.602383:0:15726:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff982a047719b8) 00000020:00000080:2.0:1787574446.602398:0:15726:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787574446.620687:0:15726:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787574446.621539:0:15726:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787574446.622482:0:15726:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787574446.624400:0:15726:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787574446.624962:0:15726:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787574446.625412:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 539: rc = 0 00100000:10000000:2.0:1787574446.625623:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 539: rc = 0 00100000:10000000:2.0:1787574446.625810:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 539: rc = 0 00100000:10000000:2.0:1787574446.626515:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 73: rc = 0 00100000:10000000:2.0:1787574446.627029:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 73: rc = 0 00100000:10000000:3.0:1787574446.627537:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 73: rc = 0 00100000:10000000:3.0:1787574446.627991:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 73: rc = 0 00100000:10000000:3.0:1787574446.628629:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 73: rc = 0 00100000:10000000:3.0:1787574446.629061:0:15726:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 73: rc = 0 00000020:00000080:3.0:1787574446.629685:0:15726:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787574446.629698:0:15726:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787574446.629708:0:15726:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xfe91058e646c0934 00000020:01000004:3.0:1787574446.629867:0:15726:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787574446.629967:0:15726:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787574446.629970:0:15726:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787574446.629976:0:15726:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787574446.629998:0:15726:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787574446.630002:0:15726:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:00080000:1.0:1787574446.643809:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:01000000:3.0:1787574446.650622:0:15726:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787574446.650670:0:15726:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.151@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787574446.650674:0:15726:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787574446.650675:0:15726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787574446.650677:0:15726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574446.650678:0:15726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574446.650679:0:15726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574446.650680:0:15726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574446.650682:0:15726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787574446.650684:0:15726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574446.650685:0:15726:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787574446.650688:0:15726:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787574446.650690:0:15726:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787574446.650691:0:15726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787574446.650692:0:15726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574446.650697:0:15726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574446.650698:0:15726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574446.650699:0:15726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574446.650700:0:15726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787574446.650701:0:15726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574446.650702:0:15726:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787574446.653010:0:15726:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787574446.653037:0:15726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290140160:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787574446.653109:0:15726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574446.653416:0:15726:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04c65180 going to sleep for 11 seconds 00000100:00100000:1.0:1787574446.653511:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290140160 00000100:00100000:1.0:1787574446.653518:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290140160 00000100:00100000:1.0:1787574446.653575:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787574446.653585:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06995c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:15726:x1874407290140160:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787574446.653613:0:14319:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787574446.653616:0:14319:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787574446.653619:0:14319:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787574446.658896:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06995c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:15726:x1874407290140160:12345-0@lo:253:mount.lustre.0 Request processed in 5305us (5780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574446.658911:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787574446.658993:0:15726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290140160:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787574446.659006:0:15726:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787574446.659010:0:15726:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787574446.659012:0:15726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787574446.659013:0:15726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574446.659014:0:15726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574446.659015:0:15726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574446.659017:0:15726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574446.659018:0:15726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787574446.659020:0:15726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574446.659021:0:15726:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787574446.659040:0:15726:0:(tgt_mount.c:101:server_register_mount()) register mount ffff982a2e03e000 from lustre-OST0001 10000000:01000000:3.0:1787574446.659063:0:15726:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787574446.659066:0:15726:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787574446.659073:0:15726:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff982a03e93370 local copy 00010000:00010000:3.0:1787574446.659083:0:15726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a069fbc00/0xfe91058e646c07a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c07ac expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574446.660234:0:15726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290140288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574446.660284:0:15726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574446.660323:0:15726:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04c65480 going to sleep for 11 seconds 00000100:00100000:2.0:1787574446.660604:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290140288 00000100:00100000:2.0:1787574446.660611:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290140288 00000100:00100000:2.0:1787574446.660662:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787574446.660672:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:15726:x1874407290140288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574446.660858:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:15726:x1874407290140288:12345-0@lo:501:mount.lustre.0 Request processed in 187us (574us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787574446.660866:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787574446.660925:0:15726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290140288:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787574446.660942:0:15726:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787574446.661240:0:15726:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787574446.661249:0:15726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a069fbc00/0xfe91058e646c07a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c07ac expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574446.661261:0:15726:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a069fbc00/0xfe91058e646c07a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c07ac expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574446.661291:0:15726:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff982a2e03e000 10000000:01000000:3.0:1787574446.661296:0:15726:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787574446.661302:0:15726:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787574446.661304:0:15726:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787574446.661309:0:15726:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787574446.661312:0:15726:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787574446.661335:0:15726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a027f2400/0xfe91058e646c093b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574446.661423:0:15726:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a027f2400/0xfe91058e646c093b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574446.661435:0:15726:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a027f2400/0xfe91058e646c093b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574446.661450:0:15726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290140416:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787574446.661498:0:15726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574446.661828:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290140416 00000100:00100000:1.0:1787574446.661835:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290140416 00000100:00100000:1.0:1787574446.661878:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787574446.661886:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:15726:x1874407290140416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574446.661897:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574446.661913:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a057e1e00/0xfe91058e646c0942 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646c093b expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.661933:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a057e1e00/0xfe91058e646c0942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646c093b expref: 17 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.661942:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a057e1e00/0xfe91058e646c0942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c093b expref: 17 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.661964:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1e00, rc 0) 00000100:00100000:3.0:1787574446.662064:0:15726:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04c65480 going to sleep for 11 seconds 00000100:00100000:1.0:1787574446.662270:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+17:15726:x1874407290140416:12345-0@lo:101:mount.lustre.0 Request processed in 384us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574446.662278:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787574446.662444:0:15726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290140416:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574446.662458:0:15726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a027f2400/0xfe91058e646c093b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0942 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574446.662489:0:15726:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a027f2400/0xfe91058e646c093b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646c0942 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787574446.664383:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787574446.665522:0:15726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787574446.665764:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787574446.665808:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787574446.665839:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787574446.665886:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787574446.665924:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787574446.665960:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787574446.666040:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787574446.666048:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787574446.666128:0:15726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290140544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574446.666485:0:15726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574446.666567:0:15726:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a2e01a480 going to sleep for 11 seconds 00000100:00100000:1.0:1787574446.666611:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290140544 00000100:00100000:1.0:1787574446.666619:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290140544 00000100:00100000:1.0:1787574446.666700:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787574446.666710:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+17:15726:x1874407290140544:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574446.667110:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+17:15726:x1874407290140544:12345-0@lo:501:mount.lustre.0 Request processed in 400us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574446.667119:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787574446.667274:0:15726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290140544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574446.667529:0:15726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290140672:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787574446.667578:0:15726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574446.667607:0:15726:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04c65480 going to sleep for 11 seconds 00000100:00100000:2.0:1787574446.667660:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290140672 00000100:00100000:2.0:1787574446.667664:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290140672 00000100:00100000:2.0:1787574446.667701:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787574446.667709:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+17:15726:x1874407290140672:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787574446.668036:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+17:15726:x1874407290140672:12345-0@lo:503:mount.lustre.0 Request processed in 327us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574446.668044:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787574446.668292:0:15726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290140672:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787574446.668999:0:15726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787574446.669064:0:15726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290140800:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574446.672505:0:15726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574446.672556:0:15726:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a069f8240 going to sleep for 11 seconds 00000100:00100000:3.0:1787574446.672632:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290140800 00000100:00100000:3.0:1787574446.672641:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290140800 00000100:00100000:3.0:1787574446.672696:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787574446.672706:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+17:15726:x1874407290140800:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574446.672987:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+17:15726:x1874407290140800:12345-0@lo:502:mount.lustre.0 Request processed in 282us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574446.672996:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787574446.673342:0:15726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290140800:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787574446.673608:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787574446.673659:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787574446.673693:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787574446.673740:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787574446.673775:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787574446.673806:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787574446.673850:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787574446.673884:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787574446.673927:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1787574446.673965:0:15726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290140928:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574446.674019:0:15726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574446.674047:0:15726:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a069f8240 going to sleep for 11 seconds 00000100:00100000:3.0:1787574446.674128:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290140928 00000100:00100000:3.0:1787574446.674145:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290140928 00000100:00100000:3.0:1787574446.674384:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787574446.674394:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+17:15726:x1874407290140928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574446.674583:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+17:15726:x1874407290140928:12345-0@lo:502:mount.lustre.0 Request processed in 191us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574446.674591:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787574446.674678:0:15726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290140928:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787574446.674750:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1787574446.674760:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1787574446.675788:0:15727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787574446.675797:0:15727:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787574446.675803:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574446.675805:0:15727:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787574446.675812:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787574446.675834:0:15727:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff982904c799b8) 00000020:00000080:0.0:1787574446.675854:0:15727:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787574446.675860:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787574446.675918:0:15727:0:(tgt_mount.c:153:server_get_mount()) get mount ffff982a2e03e000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787574446.675925:0:15727:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787574446.675932:0:15727:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xfe91058e646c0950 00010000:00010000:0.0:1787574446.679944:0:15727:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1787574446.682037:0:15727:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1787574446.688750:0:15727:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787574446.690907:0:15727:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787574446.690920:0:15727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574446.690926:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574446.690928:0:15727:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787574446.690933:0:15727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574446.690937:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574446.690938:0:15727:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787574446.690941:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787574446.690942:0:15727:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787574446.690945:0:15727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574446.690947:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574446.690948:0:15727:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787574446.690950:0:15727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574446.690952:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574446.690953:0:15727:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787574446.690956:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787574446.691012:0:15727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574446.691021:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574446.691023:0:15727:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787574446.691026:0:15727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787574446.692720:0:15726:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787574446.692759:0:15726:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787574446.692822:0:15726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a027f2400/0xfe91058e646c093b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0942 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574446.692855:0:15726:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a027f2400/0xfe91058e646c093b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0942 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574446.692864:0:15726:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982a2e03e000 from 1 10000000:01000000:3.0:1787574446.692866:0:15726:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787574446.692902:0:15726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a027f3600/0xfe91058e646c0957 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574446.692910:0:15726:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a027f3600/0xfe91058e646c0957 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574446.692923:0:15726:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a027f3600/0xfe91058e646c0957 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574446.692946:0:15726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290141056:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787574446.693011:0:15726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574446.693058:0:15726:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04c65540 going to sleep for 11 seconds 00000100:00100000:1.0:1787574446.694269:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290141056 00000100:00100000:1.0:1787574446.694280:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290141056 00000100:00100000:1.0:1787574446.694341:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787574446.694351:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+17:15726:x1874407290141056:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574446.694370:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574446.694385:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a057e1c00/0xfe91058e646c095e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646c0957 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.694412:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a057e1c00/0xfe91058e646c095e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646c0957 expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.694424:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a057e1c00/0xfe91058e646c095e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c0957 expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.694927:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1c00, rc 0) 00000100:00100000:1.0:1787574446.695009:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+18:15726:x1874407290141056:12345-0@lo:101:mount.lustre.0 Request processed in 659us (1997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574446.695017:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787574446.695121:0:15726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290141056:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574446.695155:0:15726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a027f3600/0xfe91058e646c0957 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c095e expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574446.695190:0:15726:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a027f3600/0xfe91058e646c0957 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646c095e expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787574446.695763:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787574446.696261:0:15726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787574446.696509:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787574446.696551:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787574446.696619:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787574446.696627:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787574446.696692:0:15726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290141184:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574446.696748:0:15726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574446.696792:0:15726:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04c65540 going to sleep for 11 seconds 00000100:00100000:1.0:1787574446.697639:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290141184 00000100:00100000:1.0:1787574446.697649:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290141184 00000100:00100000:1.0:1787574446.697700:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787574446.697712:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+18:15726:x1874407290141184:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574446.697993:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+18:15726:x1874407290141184:12345-0@lo:501:mount.lustre.0 Request processed in 281us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574446.698001:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787574446.700607:0:15726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290141184:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574446.700669:0:15726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290141312:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787574446.700740:0:15726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574446.703290:0:15726:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04c65540 going to sleep for 11 seconds 00000100:00100000:2.0:1787574446.704346:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290141312 00000100:00100000:2.0:1787574446.704357:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290141312 00000100:00100000:2.0:1787574446.704423:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787574446.704434:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+18:15726:x1874407290141312:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787574446.704702:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+18:15726:x1874407290141312:12345-0@lo:503:mount.lustre.0 Request processed in 269us (3961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574446.704720:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787574446.704804:0:15726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290141312:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787574446.707508:0:15726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787574446.707791:0:15726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290141440:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574446.707868:0:15726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574446.708298:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290141440 00000100:00100000:3.0:1787574446.708316:0:15726:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04c65540 going to sleep for 11 seconds 00000100:00100000:0.0:1787574446.708363:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290141440 00000100:00100000:0.0:1787574446.708412:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787574446.708421:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+18:15726:x1874407290141440:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574446.708731:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+18:15726:x1874407290141440:12345-0@lo:502:mount.lustre.0 Request processed in 309us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574446.708739:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787574446.708863:0:15726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290141440:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787574446.709124:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787574446.712808:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787574446.712903:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787574446.712944:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787574446.712980:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787574446.713118:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787574446.713374:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787574446.713409:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787574446.713462:0:15726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290141568:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574446.713560:0:15726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574446.713607:0:15726:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04c65540 going to sleep for 11 seconds 00000100:00100000:2.0:1787574446.713617:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290141568 00000100:00100000:2.0:1787574446.713626:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290141568 00000100:00100000:2.0:1787574446.713675:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787574446.713686:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3b95d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+18:15726:x1874407290141568:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574446.713880:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3b95d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+18:15726:x1874407290141568:12345-0@lo:502:mount.lustre.0 Request processed in 195us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574446.713887:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787574446.714120:0:15726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290141568:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787574446.714262:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787574446.714272:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787574446.717779:0:15731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574446.717791:0:15731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574446.717794:0:15731:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787574446.717805:0:15731:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982a2e03e000 00000020:00000080:0.0:1787574446.717807:0:15731:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787574446.717814:0:15731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574446.717816:0:15731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574446.717817:0:15731:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787574446.717819:0:15731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574446.717821:0:15731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574446.717822:0:15731:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787574446.717825:0:15731:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982a2e03e000 00000020:00000080:0.0:1787574446.717827:0:15731:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787574446.717883:0:15731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574446.717887:0:15731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574446.717888:0:15731:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787574446.717891:0:15731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574446.717909:0:15731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574446.717910:0:15731:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787574446.717924:0:15731:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff982a2e03e000 00000020:00000080:0.0:1787574446.717927:0:15731:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787574446.717969:0:15731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574446.717972:0:15731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574446.717974:0:15731:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787574446.717978:0:15731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787574446.718133:0:15726:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787574446.718192:0:15726:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787574446.718213:0:15726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a027f3600/0xfe91058e646c0957 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c095e expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574446.718224:0:15726:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a027f3600/0xfe91058e646c0957 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c095e expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574446.718265:0:15726:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787574446.718269:0:15726:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff982a2e03e000 10000000:01000000:3.0:1787574446.718272:0:15726:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff982a2e03e000 10000000:01000000:3.0:1787574446.718276:0:15726:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787574446.718282:0:15726:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982a2e03e000 from 1 10000000:01000000:3.0:1787574446.718285:0:15726:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787574446.718325:0:15726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a027f2200/0xfe91058e646c0965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574446.718334:0:15726:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a027f2200/0xfe91058e646c0965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574446.718355:0:15726:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a027f2200/0xfe91058e646c0965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574446.718388:0:15726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290141696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787574446.718451:0:15726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574446.718504:0:15726:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04c65540 going to sleep for 11 seconds 00000100:00100000:1.0:1787574446.719588:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290141696 00000100:00100000:1.0:1787574446.719611:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290141696 00000100:00100000:1.0:1787574446.719661:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787574446.719672:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3b95f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+18:15726:x1874407290141696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574446.719691:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574446.719707:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a057e0000/0xfe91058e646c096c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646c0965 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.719733:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a057e0000/0xfe91058e646c096c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646c0965 expref: 19 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.719744:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a057e0000/0xfe91058e646c096c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c0965 expref: 19 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.719754:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0000, rc 0) 00000100:00100000:1.0:1787574446.719825:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3b95f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:15726:x1874407290141696:12345-0@lo:101:mount.lustre.0 Request processed in 155us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574446.719833:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787574446.719931:0:15726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290141696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574446.719956:0:15726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a027f2200/0xfe91058e646c0965 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c096c expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574446.719966:0:15726:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a027f2200/0xfe91058e646c0965 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646c096c expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787574446.721901:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787574446.722285:0:15726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787574446.722568:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787574446.722615:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787574446.722657:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787574446.722717:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787574446.722767:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787574446.722848:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787574446.722904:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787574446.722944:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787574446.723025:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787574446.723076:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787574446.723135:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787574446.723223:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787574446.723279:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787574446.723336:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787574446.723390:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787574446.723428:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787574446.723461:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787574446.723550:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787574446.723591:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787574446.723633:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787574446.723708:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787574446.723759:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787574446.723815:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787574446.723906:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787574446.723979:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787574446.724035:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787574446.724104:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787574446.724191:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787574446.724241:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787574446.728791:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1787574446.728862:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1787574446.729972:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1787574446.730035:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1787574446.730117:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1787574446.730189:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1787574446.730255:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1787574446.730300:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1787574446.730401:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1787574446.730410:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787574446.730636:0:15726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290141824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574446.730709:0:15726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574446.730757:0:15726:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04c65540 going to sleep for 11 seconds 00000100:00100000:1.0:1787574446.730867:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290141824 00000100:00100000:1.0:1787574446.730875:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290141824 00000100:00100000:1.0:1787574446.730931:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787574446.730942:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3b95e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:15726:x1874407290141824:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574446.731224:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3b95e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:15726:x1874407290141824:12345-0@lo:501:mount.lustre.0 Request processed in 283us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574446.731233:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787574446.731564:0:15726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290141824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574446.731606:0:15726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290141952:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787574446.731653:0:15726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574446.731684:0:15726:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04c65540 going to sleep for 11 seconds 00000100:00100000:1.0:1787574446.731735:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290141952 00000100:00100000:1.0:1787574446.731740:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290141952 00000100:00100000:1.0:1787574446.731770:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787574446.731779:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3b95f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:15726:x1874407290141952:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787574446.732110:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3b95f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:15726:x1874407290141952:12345-0@lo:503:mount.lustre.0 Request processed in 332us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574446.732118:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787574446.734047:0:15726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290141952:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787574446.734800:0:15726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787574446.734907:0:15726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290142080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574446.734983:0:15726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574446.735026:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290142080 00000100:00100000:3.0:1787574446.735032:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290142080 00000100:00100000:3.0:1787574446.735081:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787574446.735090:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3b95dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:15726:x1874407290142080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574446.735290:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3b95dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:15726:x1874407290142080:12345-0@lo:502:mount.lustre.0 Request processed in 200us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574446.735298:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787574446.735341:0:15726:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04c65540 going to sleep for 11 seconds 00000100:00100000:3.0:1787574446.735355:0:15726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290142080:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787574446.735882:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787574446.735959:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787574446.736014:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787574446.736092:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787574446.736144:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787574446.736308:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787574446.736356:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787574446.736397:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787574446.736741:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787574446.736812:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787574446.736855:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787574446.736926:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787574446.736964:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787574446.736996:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787574446.737040:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787574446.737097:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787574446.737682:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787574446.737786:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787574446.737855:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787574446.737973:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787574446.738372:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787574446.738499:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787574446.738546:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787574446.738620:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787574446.738669:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787574446.738716:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787574446.738776:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787574446.738820:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787574446.738922:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787574446.738997:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787574446.739030:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787574446.739080:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787574446.739113:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787574446.739787:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787574446.739833:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787574446.739889:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787574446.740048:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787574446.740090:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787574446.740217:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787574446.740264:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787574446.740315:0:15726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290142208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574446.740411:0:15726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574446.740463:0:15726:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04c65540 going to sleep for 11 seconds 00000100:00100000:3.0:1787574446.742218:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290142208 00000100:00100000:3.0:1787574446.742230:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290142208 00000100:00100000:3.0:1787574446.742282:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787574446.742292:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907def050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:15726:x1874407290142208:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574446.742697:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907def050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:15726:x1874407290142208:12345-0@lo:502:mount.lustre.0 Request processed in 405us (2285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574446.742705:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787574446.742781:0:15726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290142208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787574446.742891:0:15726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787574446.742913:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787574446.747434:0:15736:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787574446.747451:0:15736:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff982a2bcab370) 00000020:00000080:3.0:1787574446.747497:0:15736:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1787574446.747587:0:15736:0:(tgt_mount.c:153:server_get_mount()) get mount ffff982a2e03e000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787574446.747591:0:15736:0:(tgt_mount.c:187:server_put_mount()) put mount ffff982a2e03e000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787574446.747593:0:15736:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982a2e03e000 3 00010000:00080000:3.0:1787574446.747622:0:15736:0:(ldlm_lib.c:102:import_set_conn()) imp ffff982a4192e800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1787574446.749779:0:15736:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1787574446.750028:0:15736:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787574446.750065:0:15736:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787574446.750082:0:15736:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xfe91058e646c097a 00000100:00080000:3.0:1787574446.750093:0:15736:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787574446.750099:0:15736:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff982a4192e800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1787574446.750134:0:15736:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982a3a8aa300 x1874407290142336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574446.750196:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1874407290142336:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787574446.750265:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787574446.750325:0:15736:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787574446.750360:0:14219:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574446.750364:0:14219:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574446.750367:0:14219:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574446.750370:0:14219:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787574446.750414:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874407290142464:0@lo:400:kworker.0 00000100:00100000:3.0:1787574446.750438:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574446.750489:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290142592:0@lo:400:kworker.0 00000100:00100000:3.0:1787574446.750522:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574446.750551:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290142336 00000100:00100000:3.0:1787574446.750557:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290142336 00000100:00100000:3.0:1787574446.750586:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290142464 00000100:00100000:3.0:1787574446.750589:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290142464 00000100:00100000:2.0:1787574446.750659:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290142592 00000100:00100000:2.0:1787574446.750665:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290142592 00000100:00100000:2.0:1787574446.750688:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787574446.750696:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874407290142464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574446.750749:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874407290142464:12345-0@lo:400:kworker.0 Request processed in 52us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574446.750755:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787574446.750768:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787574446.750774:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290142592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574446.750802:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290142592:12345-0@lo:400:kworker.0 Request processed in 29us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574446.750808:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787574446.750826:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787574446.750829:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3297:x1874407290142336:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787574446.750849:0:15671:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:2.0:1787574446.750878:0:15671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xfe91058e646c0981 00000004:00100000:2.0:1787574446.750895:0:15671:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787574446.750932:0:15671:0:(import.c:65:import_set_state_nolock()) ffff9829046fa000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574446.750969:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1874407290142336:12345-0@lo:38:llog_process_th.0 Request processed in 138us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574446.750974:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787574446.752729:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a3a8ab800 x1874407290142592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574446.752745:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290142592:0@lo:400:kworker.0 00010000:00080000:3.0:1787574446.752778:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a3a8aa680 x1874407290142464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574446.752788:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874407290142464:0@lo:400:kworker.0 00010000:00080000:3.0:1787574446.752810:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982a3a8aa300 x1874407290142336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574446.752817:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787574446.752824:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787574446.752832:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787574446.752836:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787574446.752839:0:3297:0:(import.c:65:import_set_state_nolock()) ffff982a4192e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787574446.752846:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1874407290142336:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787574446.759620:0:15736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1787574446.759747:0:15726:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787574446.759779:0:15726:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787574446.759810:0:15726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a027f2200/0xfe91058e646c0965 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c096c expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574446.759823:0:15726:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a027f2200/0xfe91058e646c0965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c096c expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787574446.759880:0:15726:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787574446.759883:0:15726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787574446.759884:0:15726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574446.759886:0:15726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574446.759887:0:15726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574446.759889:0:15726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574446.759890:0:15726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787574446.759892:0:15726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574446.759893:0:15726:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787574446.759897:0:15726:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787574446.759899:0:15726:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787574446.759900:0:15726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787574446.759901:0:15726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574446.759903:0:15726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574446.759903:0:15726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574446.759904:0:15726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574446.759905:0:15726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787574446.759906:0:15726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574446.759907:0:15726:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787574446.759944:0:15726:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787574446.759965:0:15726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290142720:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787574446.760037:0:15726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574446.760078:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290142720 00000100:00100000:3.0:1787574446.760085:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290142720 00000100:00100000:3.0:1787574446.760137:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787574446.760148:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907dee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:15726:x1874407290142720:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787574446.760214:0:14319:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787574446.760229:0:14319:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787574446.760773:0:15726:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04c65180 going to sleep for 11 seconds 20000000:01000000:3.0:1787574446.809116:0:14319:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787574446.809144:0:14319:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787574446.809942:0:14340:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787574446.809949:0:14340:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787574446.809970:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982a41d01800/0xfe91058e646c0988 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574446.809989:0:14340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a069fa400/0xfe91058e646c0926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c091f expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574446.809998:0:14340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982a41d01800/0xfe91058e646c0988 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574446.810035:0:14340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a069fa400/0xfe91058e646c0926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646c091f expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574446.810048:0:14340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982a069fa400/0xfe91058e646c0926 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646c091f expref: 19 pid: 14318 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574446.810062:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14340:1874407290142848:0@lo:104: 00000100:00100000:0.0:1787574446.810127:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574446.810205:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a069f8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574446.812526:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290142848 00000100:00100000:3.0:1787574446.812544:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290142848 00000100:00100000:3.0:1787574446.812620:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787574446.812631:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b2841886-4ae8-43da-bc7c-46b9b13f805e+3:14340:x1874407290142848:12345-0@lo:104: 00010000:00010000:3.0:1787574446.812649:0:14308:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a057e1a00/0xfe91058e646c091f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646c0926 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574446.812754:0:14308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787574446.812761:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b2841886-4ae8-43da-bc7c-46b9b13f805e+3:14340:x1874407290142848:12345-0@lo:104: Request processed in 133us (2634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574446.812768:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787574446.812815:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574446.812825:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a057e1a00/0xfe91058e646c091f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646c0926 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.812834:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1a00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:1.0:1787574446.812838:0:14312:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a057e1a00/0xfe91058e646c091f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646c0926 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.812848:0:14312:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a057e1a00/0xfe91058e646c091f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646c0926 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574446.812855:0:14312:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a057e1a00/0xfe91058e646c091f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646c0926 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574446.812860:0:14312:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574446.812902:0:14312:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a057e1a00/0xfe91058e646c091f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646c0926 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.812908:0:14312:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574446.812923:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a057e1a00/0xfe91058e646c091f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646c0926 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.812929:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a057e1a00/0xfe91058e646c091f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646c0926 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.812945:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574446.812947:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574446.812956:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574446.813077:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2841886-4ae8-43da-bc7c-46b9b13f805e:3299:1874407290142976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574446.813115:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574446.813352:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14340:1874407290142848:0@lo:104: 00010000:00010000:0.0:1787574446.813373:0:14340:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982a41d01800/0xfe91058e646c0988 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574446.813728:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290142976 00000100:00100000:1.0:1787574446.813736:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290142976 00010000:00010000:1.0:1787574446.813764:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a069fa400/0xfe91058e646c0926 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646c091f expref: 20 pid: 14318 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574446.813811:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787574446.813821:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2841886-4ae8-43da-bc7c-46b9b13f805e+20:3299:x1874407290142976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787574446.813835:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574446.813841:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a069fa400/0xfe91058e646c0926 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646c091f expref: 20 pid: 14318 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.813855:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a069fa400/0xfe91058e646c0926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646c091f expref: 20 pid: 14318 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.813873:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a069fa400/0xfe91058e646c0926 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646c091f expref: 20 pid: 14318 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.813891:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982a41d01800/0xfe91058e646c0988 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.813900:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a41d01800/0xfe91058e646c0988 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787574446.813915:0:14311:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003966942s 00010000:00010000:1.0:1787574446.813919:0:14311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a41d01800/0xfe91058e646c0988 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.813927:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a41d01800/0xfe91058e646c0988 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.813934:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982a41d01800/0xfe91058e646c0988 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.813947:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982a41d01800/0xfe91058e646c0988 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.813953:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01800 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574446.813958:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982a41d01800/0xfe91058e646c0988 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.813965:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982a41d01800/0xfe91058e646c0988 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.813980:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982a41d01800/0xfe91058e646c0988 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574446.813992:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574446.814044:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:3299:x1874407290142976:12345-0@lo:103:ldlm_bl.0 Request processed in 225us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574446.814053:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787574446.816497:0:14340:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982a41d01800/0xfe91058e646c0988 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574446.816515:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982a41d01800/0xfe91058e646c0988 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574446.816522:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a41d01800/0xfe91058e646c0988 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574446.817510:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2841886-4ae8-43da-bc7c-46b9b13f805e:3299:1874407290142976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574446.829017:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907dee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+18:15726:x1874407290142720:12345-0@lo:253:mount.lustre.0 Request processed in 68864us (68972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574446.829032:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787574446.829293:0:15726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2841886-4ae8-43da-bc7c-46b9b13f805e:15726:1874407290142720:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787574446.829311:0:15726:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787574446.829314:0:15726:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787574446.829315:0:15726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787574446.829316:0:15726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787574446.829317:0:15726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787574446.829318:0:15726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787574446.829319:0:15726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787574446.829322:0:15726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787574446.829323:0:15726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787574446.829324:0:15726:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787574446.829341:0:15726:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787574446.840896:0:15726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787574446.841083:0:15726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787574446.841267:0:15726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787574446.841416:0:15726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787574446.841580:0:15726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787574446.841794:0:15726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787574446.843574:0:15726:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787574446.915533:0:15726:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787574446.915542:0:15726:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787574446.915571:0:15726:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787574446.915625:0:15726:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787574446.915637:0:15726:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787574446.915663:0:15726:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787574447.282197:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574448.307282:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787574448.625242:0:14321:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787574448.625252:0:14321:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff982905b62800 from 8 10000000:01000000:3.0:1787574448.625258:0:14321:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787574448.625323:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a027f2800/0xfe91058e646c098f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.625337:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a027f2800/0xfe91058e646c098f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.625352:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a027f2800/0xfe91058e646c098f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574448.625385:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290143104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787574448.625920:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574448.626286:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290143104 00000100:00100000:2.0:1787574448.626298:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290143104 00000100:00100000:3.0:1787574448.626304:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0499ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787574448.626370:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787574448.626382:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907dec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+18:14321:x1874407290143104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574448.626399:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574448.626431:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a069faa00/0xfe91058e646c0996 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646c098f expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574448.626474:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a069faa00/0xfe91058e646c0996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646c098f expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574448.626487:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a069faa00/0xfe91058e646c0996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c098f expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574448.626498:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069faa00, rc 0) 00000100:00100000:2.0:1787574448.627551:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907dec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:14321:x1874407290143104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1165us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574448.627562:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787574448.631312:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290143104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574448.631353:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a027f2800/0xfe91058e646c098f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0996 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.631609:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a027f2800/0xfe91058e646c098f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646c0996 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574448.631716:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290143232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787574448.631805:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574448.633729:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290143232 00000100:00100000:0.0:1787574448.633759:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a02e0c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787574448.633871:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290143232 00000100:00100000:3.0:1787574448.634009:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787574448.634022:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907decc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:14321:x1874407290143232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787574448.634054:0:14319:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787574448.634079:0:14319:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787574448.634083:0:14319:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1787574448.634267:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907decc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:14321:x1874407290143232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 246us (2461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574448.634276:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787574448.634634:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290143232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787574448.634726:0:14321:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787574448.634739:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a027f2800/0xfe91058e646c098f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0996 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574448.634764:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a027f2800/0xfe91058e646c098f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0996 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.329284:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574449.847022:0:3297:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574434/real 1787574434] req@ffff982a3a8aaa00 x1874407290135936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574449 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574449.847075:0:3297:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff982a3a8aaa00 x1874407290135936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574449 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574449.847088:0:3297:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574434/real 1787574434] req@ffff982a3a8a8a80 x1874407290136064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574449 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574449.847102:0:3297:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff982a3a8a8a80 x1874407290136064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574449 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787574449.847261:0:3297:0:(import.c:65:import_set_state_nolock()) ffff982a0814b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787574449.847294:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787574449.847300:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874407290135936:0@lo:8:kworker.0 00000100:00080000:3.0:1787574449.847307:0:3297:0:(import.c:65:import_set_state_nolock()) ffff982a40f8f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787574449.847312:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787574449.847316:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874407290136064:0@lo:8:kworker.0 00000100:00080000:1.0:1787574449.847544:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787574449.847550:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787574449.847553:0:467:0:(import.c:65:import_set_state_nolock()) ffff982a0814b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787574449.847558:0:467:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 410 00000100:00080000:1.0:1787574449.847564:0:467:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787574449.847571:0:467:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff982a0814b000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1787574449.847593:0:467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982a419a3800 x1874407290143488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787574449.847605:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787574449.847608:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787574449.847610:0:467:0:(import.c:65:import_set_state_nolock()) ffff982a40f8f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787574449.847613:0:467:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 410 00000100:00080000:1.0:1787574449.847615:0:467:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787574449.847619:0:467:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff982a40f8f800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1787574449.847630:0:467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982a419a3100 x1874407290143616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787574449.847688:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874407290143744:0@lo:400:kworker.0 00000100:00100000:0.0:1787574449.847805:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2841886-4ae8-43da-bc7c-46b9b13f805e:3300:1874407290143360:0@lo:400:kworker.0 00000100:00100000:0.0:1787574449.847888:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574449.848085:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290143872:0@lo:400:kworker.0 00000100:00100000:0.0:1787574449.848118:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574449.848154:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574449.848160:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290144000:0@lo:400:kworker.0 00000100:00100000:0.0:1787574449.848213:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574449.848244:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290143872 00000100:00100000:0.0:1787574449.848252:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290143872 00000100:00100000:0.0:1787574449.848313:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290144000 00000100:00100000:0.0:1787574449.848316:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290144000 00000100:00100000:0.0:1787574449.848341:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787574449.848351:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290143872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574449.848405:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290143872:12345-0@lo:400:kworker.0 Request processed in 56us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574449.848412:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787574449.848432:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787574449.848437:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290144000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574449.848477:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290144000:12345-0@lo:400:kworker.0 Request processed in 40us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574449.848483:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787574449.848515:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787574449.848544:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419a0000 x1874407290144000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574449.848559:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290144000:0@lo:400:kworker.0 00010000:00080000:0.0:1787574449.848569:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419a2a00 x1874407290143872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574449.848578:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290143872:0@lo:400:kworker.0 00000100:00100000:3.0:1787574449.848760:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290143360 00000100:00100000:3.0:1787574449.848765:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290143360 00000100:00100000:3.0:1787574449.848802:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787574449.848809:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907dee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:3300:x1874407290143360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574449.849109:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907dee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:3300:x1874407290143360:12345-0@lo:400:kworker.0 Request processed in 299us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574449.849208:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574449.849239:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290143744 00000100:00100000:0.0:1787574449.849244:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290143744 00000100:00100000:0.0:1787574449.849268:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787574449.849275:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874407290143744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574449.849311:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874407290143744:12345-0@lo:400:kworker.0 Request processed in 37us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574449.849318:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787574449.849347:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419a1500 x1874407290143744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574449.849359:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874407290143744:0@lo:400:kworker.0 00000100:00100000:0.0:1787574449.849396:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874407290143488:0@lo:8:kworker.0 00000100:00100000:0.0:1787574449.849430:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574449.849477:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874407290143616:0@lo:8:kworker.0 00000100:00100000:0.0:1787574449.849499:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574449.849560:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290143488 00000100:00100000:0.0:1787574449.849564:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290143488 00000100:00100000:0.0:1787574449.849582:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290143616 00000100:00100000:0.0:1787574449.849595:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290143616 00000100:00100000:0.0:1787574449.849611:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574449.849616:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3297:x1874407290143488:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787574449.849644:0:15008:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:0.0:1787574449.849678:0:15008:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfe91058e646c099d 00002000:00100000:0.0:1787574449.849694:0:15008:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9829063d8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787574449.849699:0:15008:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787574449.849703:0:15008:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1787574449.849814:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787574449.850092:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2841886-4ae8-43da-bc7c-46b9b13f805e:3300:1874407290143360:0@lo:400:kworker.0 00002000:00080000:0.0:1787574449.851360:0:15008:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787574449.851397:0:15008:0:(import.c:65:import_set_state_nolock()) ffff9829063db800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574449.851500:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3297:x1874407290143488:12345-0@lo:8:kworker.0 Request processed in 1881us (2067us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574449.851510:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574449.851539:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574449.851546:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3297:x1874407290143616:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787574449.851570:0:15008:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:0.0:1787574449.851596:0:15008:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfe91058e646c09a4 00002000:00100000:0.0:1787574449.851609:0:15008:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9829063da000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787574449.851613:0:15008:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787574449.851616:0:15008:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787574449.851858:0:15008:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787574449.851871:0:15008:0:(import.c:65:import_set_state_nolock()) ffff9829063dc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574449.851899:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3297:x1874407290143616:12345-0@lo:8:kworker.0 Request processed in 353us (2399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574449.851905:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787574449.855618:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419a3800 x1874407290143488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787574469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574449.855638:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787574449.855652:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787574449.855665:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787574449.855672:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787574449.855677:0:3297:0:(import.c:65:import_set_state_nolock()) ffff982a0814b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787574449.855711:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787574449.855726:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874407290143488:0@lo:8:kworker.0 00010000:00080000:3.0:1787574449.855745:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419a3100 x1874407290143616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787574469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574449.855753:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787574449.855758:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787574449.855764:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787574449.855767:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787574449.855769:0:3297:0:(import.c:65:import_set_state_nolock()) ffff982a40f8f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787574449.855789:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787574449.855793:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874407290143616:0@lo:8:kworker.0 00000004:00080000:3.0:1787574449.855868:0:14348:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787574449.856640:0:14348:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 426031472796ns, next at 0ns, rc = 0 00000004:00080000:1.0:1787574449.856824:0:14346:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787574449.857104:0:14346:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 426031937366ns, next at 0ns, rc = 0 00000004:00080000:0.0:1787574449.859045:0:14347:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1787574449.859093:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14347:1874407290144256:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787574449.859894:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574449.859934:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a2bc68cc0 going to sleep for 11 seconds 00000004:00080000:0.0:1787574449.860090:0:14349:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1787574449.860109:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14349:1874407290144512:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787574449.860151:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574449.860186:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a2bc683c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574449.860233:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290144256 00000100:00100000:0.0:1787574449.860242:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290144256 00000100:00100000:0.0:1787574449.860306:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290144512 00000100:00100000:0.0:1787574449.860309:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290144512 00000100:00100000:0.0:1787574449.860330:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787574449.860340:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14347:x1874407290144256:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787574449.861510:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290144128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574449.861583:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574449.861623:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574449.861630:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290144384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574449.861659:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574449.861703:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290144128 00000100:00100000:1.0:1787574449.861710:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290144128 00000100:00100000:1.0:1787574449.861752:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290144384 00000100:00100000:1.0:1787574449.861757:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290144384 00000100:00100000:1.0:1787574449.861772:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787574449.861781:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1874407290144128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574449.861815:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787574449.862411:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787574449.862418:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574449.864306:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1874407290144128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2513us (2711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574449.864323:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787574449.864366:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787574449.864381:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1874407290144384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574449.864431:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787574449.864497:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1874407290144384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (2837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574449.864504:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787574449.864560:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a3adf1c00 x1874407290144384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574449.864587:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290144384:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787574449.864613:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a3adf2680 x1874407290144128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574449.864627:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290144128:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1787574449.870765:0:15006:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787574449.870780:0:15006:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787574449.870786:0:15006:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:0.0:1787574449.885600:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.885616:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b304fe72/0xfe91058e646c09ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.885637:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.885643:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.885652:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b304fe72/0xfe91058e646c09ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.885688:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b304fe72/0xfe91058e646c09ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.886049:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b304fe72/0xfe91058e646c09ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.886060:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b304fe72/0xfe91058e646c09ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.886090:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574449.886913:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574449.886925:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b304fe72/0xfe91058e646c09ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.886950:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01c00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574449.886955:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b304fe72/0xfe91058e646c09ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.886967:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b304fe72/0xfe91058e646c09ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.886995:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b304fe72/0xfe91058e646c09ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.887003:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b304fe72/0xfe91058e646c09ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.887028:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.887030:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.887032:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.888974:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.888999:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f56f1600/0xfe91058e646c09b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.889025:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.889031:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.889039:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f56f1600/0xfe91058e646c09b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.889818:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f56f1600/0xfe91058e646c09b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.889839:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f56f1600/0xfe91058e646c09b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.889860:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f56f1600/0xfe91058e646c09b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.889908:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787574449.890743:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.890752:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003422bd76/0xfe91058e646c09b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.890768:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.890773:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.890779:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003422bd76/0xfe91058e646c09b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.890793:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003422bd76/0xfe91058e646c09b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.890802:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003422bd76/0xfe91058e646c09b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.890809:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003422bd76/0xfe91058e646c09b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.890836:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787574449.890857:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574449.890865:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f56f1600/0xfe91058e646c09b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.890874:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01000 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574449.890887:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f56f1600/0xfe91058e646c09b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.890898:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f56f1600/0xfe91058e646c09b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.890920:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f56f1600/0xfe91058e646c09b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.890928:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f56f1600/0xfe91058e646c09b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.890953:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574449.890956:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003422bd76/0xfe91058e646c09b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.890963:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01200 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574449.890966:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003422bd76/0xfe91058e646c09b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.890974:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003422bd76/0xfe91058e646c09b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.890984:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003422bd76/0xfe91058e646c09b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.890992:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003422bd76/0xfe91058e646c09b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.891012:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.891014:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.891016:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.891525:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.891532:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008864d6ad/0xfe91058e646c09c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.891542:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.891545:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.891550:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008864d6ad/0xfe91058e646c09c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.891560:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008864d6ad/0xfe91058e646c09c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.891568:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008864d6ad/0xfe91058e646c09c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.891576:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008864d6ad/0xfe91058e646c09c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.891594:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574449.891602:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574449.891606:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008864d6ad/0xfe91058e646c09c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.891624:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01800 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574449.891627:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008864d6ad/0xfe91058e646c09c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.891635:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008864d6ad/0xfe91058e646c09c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.891647:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008864d6ad/0xfe91058e646c09c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.891654:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008864d6ad/0xfe91058e646c09c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.891668:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.891669:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.891670:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.892055:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.892061:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f02d11/0xfe91058e646c09c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.892070:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.892073:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.892078:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f02d11/0xfe91058e646c09c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.892088:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2f02d11/0xfe91058e646c09c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.892104:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f02d11/0xfe91058e646c09c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.892111:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f02d11/0xfe91058e646c09c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.892127:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574449.892135:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574449.892139:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2f02d11/0xfe91058e646c09c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.892145:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01400 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574449.892149:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f02d11/0xfe91058e646c09c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.892157:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f02d11/0xfe91058e646c09c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.892199:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2f02d11/0xfe91058e646c09c7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.892207:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2f02d11/0xfe91058e646c09c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.892222:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.892230:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.892232:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.892627:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.892633:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060cb9c6f/0xfe91058e646c09ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.892641:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.892644:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.892648:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060cb9c6f/0xfe91058e646c09ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.892987:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.896225:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060cb9c6f/0xfe91058e646c09ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.896253:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060cb9c6f/0xfe91058e646c09ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.896263:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060cb9c6f/0xfe91058e646c09ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.896360:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787574449.896606:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574449.896615:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060cb9c6f/0xfe91058e646c09ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.896626:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01a00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574449.896632:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060cb9c6f/0xfe91058e646c09ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.896643:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060cb9c6f/0xfe91058e646c09ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.896668:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060cb9c6f/0xfe91058e646c09ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.896677:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060cb9c6f/0xfe91058e646c09ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787574449.897345:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.897356:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003241d90c/0xfe91058e646c09d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.897371:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.897376:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.897384:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003241d90c/0xfe91058e646c09d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.897404:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003241d90c/0xfe91058e646c09d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.897414:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003241d90c/0xfe91058e646c09d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.897423:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003241d90c/0xfe91058e646c09d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.897445:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574449.897474:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1787574449.897990:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.897998:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb25b71a/0xfe91058e646c09dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.898008:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.898012:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.898016:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb25b71a/0xfe91058e646c09dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.898026:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb25b71a/0xfe91058e646c09dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.898035:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb25b71a/0xfe91058e646c09dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.898053:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb25b71a/0xfe91058e646c09dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.898062:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787574449.898483:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.898489:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9cd663e/0xfe91058e646c09e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.898498:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.898501:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.898505:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9cd663e/0xfe91058e646c09e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.898513:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9cd663e/0xfe91058e646c09e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.898521:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9cd663e/0xfe91058e646c09e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.898528:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9cd663e/0xfe91058e646c09e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.898536:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787574449.898941:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.898948:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008880d0b0/0xfe91058e646c09ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.898962:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.898965:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.898969:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008880d0b0/0xfe91058e646c09ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.898979:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008880d0b0/0xfe91058e646c09ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.898988:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008880d0b0/0xfe91058e646c09ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.898995:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008880d0b0/0xfe91058e646c09ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.899005:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787574449.899414:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.899420:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c455e918/0xfe91058e646c09f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.899428:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.899432:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.899436:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c455e918/0xfe91058e646c09f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.899445:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c455e918/0xfe91058e646c09f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.899479:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c455e918/0xfe91058e646c09f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.899486:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c455e918/0xfe91058e646c09f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.899494:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1787574449.902123:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.902140:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ca72592/0xfe91058e646c09f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.902161:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.902187:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.902195:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ca72592/0xfe91058e646c09f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.902210:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ca72592/0xfe91058e646c09f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.902223:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ca72592/0xfe91058e646c09f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.902232:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ca72592/0xfe91058e646c09f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.902257:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1787574449.902735:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.902743:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058b74a16/0xfe91058e646c09ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.902754:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.902757:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.902762:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058b74a16/0xfe91058e646c09ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.902772:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058b74a16/0xfe91058e646c09ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.902781:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058b74a16/0xfe91058e646c09ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.902789:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058b74a16/0xfe91058e646c09ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.902799:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1787574449.903252:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.903258:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000424d943d/0xfe91058e646c0a06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.903267:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.903276:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.903281:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000424d943d/0xfe91058e646c0a06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.903292:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000424d943d/0xfe91058e646c0a06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.903300:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000424d943d/0xfe91058e646c0a06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.903307:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000424d943d/0xfe91058e646c0a06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.903316:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1787574449.903759:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.903765:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d683d7da/0xfe91058e646c0a0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.903775:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.903778:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.903783:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d683d7da/0xfe91058e646c0a0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.903792:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d683d7da/0xfe91058e646c0a0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.903802:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d683d7da/0xfe91058e646c0a0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.903817:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d683d7da/0xfe91058e646c0a0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.903826:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1787574449.904271:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.904278:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f9d5744/0xfe91058e646c0a14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.904288:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.904291:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574449.905348:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1787574449.905359:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb25b71a/0xfe91058e646c09dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905372:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00a00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574449.905377:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb25b71a/0xfe91058e646c09dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905400:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb25b71a/0xfe91058e646c09dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905424:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb25b71a/0xfe91058e646c09dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905432:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb25b71a/0xfe91058e646c09dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905465:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787574449.905469:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9cd663e/0xfe91058e646c09e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905476:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01600 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574449.905479:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9cd663e/0xfe91058e646c09e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905487:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9cd663e/0xfe91058e646c09e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905497:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9cd663e/0xfe91058e646c09e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905504:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9cd663e/0xfe91058e646c09e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905531:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787574449.905535:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008880d0b0/0xfe91058e646c09ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905542:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00800 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574449.905545:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008880d0b0/0xfe91058e646c09ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905552:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008880d0b0/0xfe91058e646c09ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905561:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008880d0b0/0xfe91058e646c09ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905568:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008880d0b0/0xfe91058e646c09ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905580:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787574449.905584:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c455e918/0xfe91058e646c09f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905591:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00000 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574449.905594:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c455e918/0xfe91058e646c09f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905613:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c455e918/0xfe91058e646c09f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905624:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c455e918/0xfe91058e646c09f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905631:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c455e918/0xfe91058e646c09f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905644:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787574449.905648:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ca72592/0xfe91058e646c09f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905655:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030c00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574449.905657:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ca72592/0xfe91058e646c09f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905665:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ca72592/0xfe91058e646c09f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905675:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ca72592/0xfe91058e646c09f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905682:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ca72592/0xfe91058e646c09f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905705:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787574449.905709:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058b74a16/0xfe91058e646c09ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905716:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00031400 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574449.905783:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058b74a16/0xfe91058e646c09ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905792:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058b74a16/0xfe91058e646c09ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905803:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058b74a16/0xfe91058e646c09ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905810:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058b74a16/0xfe91058e646c09ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905823:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787574449.905826:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000424d943d/0xfe91058e646c0a06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905833:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00031a00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574449.905836:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000424d943d/0xfe91058e646c0a06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905912:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000424d943d/0xfe91058e646c0a06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905923:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000424d943d/0xfe91058e646c0a06 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905930:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000424d943d/0xfe91058e646c0a06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905945:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574449.905948:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d683d7da/0xfe91058e646c0a0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905954:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00031e00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574449.905957:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d683d7da/0xfe91058e646c0a0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905964:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d683d7da/0xfe91058e646c0a0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905974:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d683d7da/0xfe91058e646c0a0d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.905982:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d683d7da/0xfe91058e646c0a0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.906006:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574449.906008:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574449.906010:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.906147:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f9d5744/0xfe91058e646c0a14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.906162:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f9d5744/0xfe91058e646c0a14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.906190:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f9d5744/0xfe91058e646c0a14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.906199:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f9d5744/0xfe91058e646c0a14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.906225:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574449.906240:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574449.906244:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f9d5744/0xfe91058e646c0a14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.906257:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030800 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574449.906261:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f9d5744/0xfe91058e646c0a14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.906268:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f9d5744/0xfe91058e646c0a14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.906279:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f9d5744/0xfe91058e646c0a14 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.906285:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f9d5744/0xfe91058e646c0a14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.906299:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.906300:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.906302:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.907615:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.907630:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000224215e/0xfe91058e646c0a1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.907645:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.907649:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.907655:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000224215e/0xfe91058e646c0a1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.907668:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000224215e/0xfe91058e646c0a1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.907687:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000224215e/0xfe91058e646c0a1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.907696:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000224215e/0xfe91058e646c0a1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.907714:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574449.908988:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574449.909002:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000224215e/0xfe91058e646c0a1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.909017:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030a00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574449.909022:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000224215e/0xfe91058e646c0a1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.909034:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000224215e/0xfe91058e646c0a1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.909057:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000224215e/0xfe91058e646c0a1b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.909066:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000224215e/0xfe91058e646c0a1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.909088:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.909098:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.909100:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.910479:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.910493:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b8642f0/0xfe91058e646c0a22 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.910512:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.910517:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.910523:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b8642f0/0xfe91058e646c0a22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.910538:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b8642f0/0xfe91058e646c0a22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.910550:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b8642f0/0xfe91058e646c0a22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.910559:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b8642f0/0xfe91058e646c0a22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.910586:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787574449.911852:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574449.911864:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b8642f0/0xfe91058e646c0a22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.911878:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030000 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574449.911883:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b8642f0/0xfe91058e646c0a22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.911895:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b8642f0/0xfe91058e646c0a22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.911918:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b8642f0/0xfe91058e646c0a22 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.911925:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b8642f0/0xfe91058e646c0a22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.911945:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574449.911947:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574449.911948:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.917040:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.917059:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1a4cb26/0xfe91058e646c0a29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.917081:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.917087:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.917093:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1a4cb26/0xfe91058e646c0a29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.918092:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1a4cb26/0xfe91058e646c0a29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.918120:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1a4cb26/0xfe91058e646c0a29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.918131:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1a4cb26/0xfe91058e646c0a29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.918157:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574449.918188:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574449.918195:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1a4cb26/0xfe91058e646c0a29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.918204:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00031600 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574449.918210:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1a4cb26/0xfe91058e646c0a29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.918220:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1a4cb26/0xfe91058e646c0a29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.918242:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1a4cb26/0xfe91058e646c0a29 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.918250:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1a4cb26/0xfe91058e646c0a29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.918282:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.918284:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.918286:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.918334:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.918344:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003241d90c/0xfe91058e646c09d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.918352:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00e00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574449.918356:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003241d90c/0xfe91058e646c09d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.918365:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003241d90c/0xfe91058e646c09d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.918375:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003241d90c/0xfe91058e646c09d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.918383:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003241d90c/0xfe91058e646c09d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.918400:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.918401:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.918403:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.919358:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.919366:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072be8266/0xfe91058e646c0a30 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.919392:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.919396:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.919402:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072be8266/0xfe91058e646c0a30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.919414:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072be8266/0xfe91058e646c0a30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.919423:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072be8266/0xfe91058e646c0a30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.919430:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072be8266/0xfe91058e646c0a30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.919459:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574449.919470:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574449.919475:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072be8266/0xfe91058e646c0a30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.919483:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00031c00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574449.919487:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072be8266/0xfe91058e646c0a30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.919495:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072be8266/0xfe91058e646c0a30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.919519:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072be8266/0xfe91058e646c0a30 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.919526:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072be8266/0xfe91058e646c0a30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.919542:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.919544:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.919546:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.919553:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.919555:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.923339:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.923357:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081d6a286/0xfe91058e646c0a37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.923377:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.923382:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.923389:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081d6a286/0xfe91058e646c0a37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.923406:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081d6a286/0xfe91058e646c0a37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.923418:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081d6a286/0xfe91058e646c0a37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.923440:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081d6a286/0xfe91058e646c0a37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.923476:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787574449.924407:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574449.924419:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081d6a286/0xfe91058e646c0a37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.924442:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00031200 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574449.924460:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081d6a286/0xfe91058e646c0a37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.924472:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081d6a286/0xfe91058e646c0a37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.924494:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081d6a286/0xfe91058e646c0a37 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.924503:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081d6a286/0xfe91058e646c0a37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.924524:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574449.924526:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574449.924528:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.925264:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.925273:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000224215e/0xfe91058e646c0a3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.925287:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.925291:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.925297:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000224215e/0xfe91058e646c0a3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.925309:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000224215e/0xfe91058e646c0a3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.925318:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000224215e/0xfe91058e646c0a3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.925326:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000224215e/0xfe91058e646c0a3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.925343:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574449.925354:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574449.925359:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000224215e/0xfe91058e646c0a3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.925373:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030a00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574449.925376:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000224215e/0xfe91058e646c0a3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.925384:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000224215e/0xfe91058e646c0a3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.925396:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000224215e/0xfe91058e646c0a3e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.925403:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000224215e/0xfe91058e646c0a3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.925417:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.925418:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.925420:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.927439:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.927466:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f9d5744/0xfe91058e646c0a45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.927483:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.927488:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.927494:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f9d5744/0xfe91058e646c0a45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.927513:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f9d5744/0xfe91058e646c0a45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.927533:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f9d5744/0xfe91058e646c0a45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.927542:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f9d5744/0xfe91058e646c0a45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.927568:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787574449.928009:0:15901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574449.928017:0:15901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f9d5744/0xfe91058e646c0a45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.928026:0:15901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030800 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574449.928031:0:15901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f9d5744/0xfe91058e646c0a45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.928040:0:15901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f9d5744/0xfe91058e646c0a45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.928067:0:15901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f9d5744/0xfe91058e646c0a45 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.928076:0:15901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f9d5744/0xfe91058e646c0a45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.928096:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574449.928098:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574449.928101:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.928499:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.928507:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087bcf122/0xfe91058e646c0a4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.928517:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.928521:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.928526:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087bcf122/0xfe91058e646c0a4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.928537:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087bcf122/0xfe91058e646c0a4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.928546:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087bcf122/0xfe91058e646c0a4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.928553:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087bcf122/0xfe91058e646c0a4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.928582:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574449.928593:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574449.928598:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087bcf122/0xfe91058e646c0a4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.928605:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030e00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574449.928608:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087bcf122/0xfe91058e646c0a4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.928615:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087bcf122/0xfe91058e646c0a4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.928626:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087bcf122/0xfe91058e646c0a4c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.928633:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087bcf122/0xfe91058e646c0a4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.928645:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.928647:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.928648:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.929383:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.929390:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c086146f/0xfe91058e646c0a53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.929401:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.929410:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.929414:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c086146f/0xfe91058e646c0a53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.929426:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c086146f/0xfe91058e646c0a53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.929435:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c086146f/0xfe91058e646c0a53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.929443:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c086146f/0xfe91058e646c0a53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.929467:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574449.929476:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574449.929481:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c086146f/0xfe91058e646c0a53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.929488:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030400 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574449.929492:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c086146f/0xfe91058e646c0a53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.929500:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c086146f/0xfe91058e646c0a53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.929513:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c086146f/0xfe91058e646c0a53 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.929532:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c086146f/0xfe91058e646c0a53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.929547:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.929549:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.929551:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.930048:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.930055:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2257577/0xfe91058e646c0a5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.930064:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.930067:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.930072:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2257577/0xfe91058e646c0a5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.930082:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2257577/0xfe91058e646c0a5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.930090:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2257577/0xfe91058e646c0a5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.930098:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2257577/0xfe91058e646c0a5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.930119:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787574449.930610:0:15901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574449.930618:0:15901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2257577/0xfe91058e646c0a5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.930629:0:15901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030200 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574449.930634:0:15901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2257577/0xfe91058e646c0a5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.930643:0:15901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2257577/0xfe91058e646c0a5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.930658:0:15901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2257577/0xfe91058e646c0a5a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.930665:0:15901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2257577/0xfe91058e646c0a5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.930697:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574449.930698:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574449.930700:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.931237:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.931250:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d683d7da/0xfe91058e646c0a61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.931260:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.931264:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.931268:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d683d7da/0xfe91058e646c0a61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.931278:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d683d7da/0xfe91058e646c0a61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.931286:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d683d7da/0xfe91058e646c0a61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.931294:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d683d7da/0xfe91058e646c0a61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.931313:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787574449.931428:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:0.0:1787574449.931531:0:15006:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1787574449.931649:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14347:x1874407290144256:12345-0@lo:5:osp-pre-0-0.0 Request processed in 71304us (71753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574449.931659:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787574449.931733:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14347:1874407290144256:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787574449.931753:0:14347:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1787574449.931810:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14347:1874407290144640:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787574449.931850:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574449.931906:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0e7c0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574449.932010:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290144640 00000100:00100000:0.0:1787574449.932018:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290144640 00000100:00100000:0.0:1787574449.932062:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787574449.932074:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14349:x1874407290144512:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1787574449.932828:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574449.932838:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d683d7da/0xfe91058e646c0a61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.932862:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00031e00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574449.932867:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d683d7da/0xfe91058e646c0a61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.932878:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d683d7da/0xfe91058e646c0a61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.932898:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d683d7da/0xfe91058e646c0a61 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.932906:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d683d7da/0xfe91058e646c0a61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.932928:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574449.932930:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574449.932932:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787574449.934858:0:15009:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787574449.934870:0:15009:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1787574449.934876:0:15009:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1787574449.939400:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.939413:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1a4cb26/0xfe91058e646c0a68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.939433:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.939438:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.939457:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a4cb26/0xfe91058e646c0a68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.939479:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1a4cb26/0xfe91058e646c0a68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.939491:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1a4cb26/0xfe91058e646c0a68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.939500:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a4cb26/0xfe91058e646c0a68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.939529:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574449.939800:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574449.939810:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1a4cb26/0xfe91058e646c0a68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.939819:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00031600 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574449.939825:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1a4cb26/0xfe91058e646c0a68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.939915:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1a4cb26/0xfe91058e646c0a68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.939939:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1a4cb26/0xfe91058e646c0a68 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.939946:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1a4cb26/0xfe91058e646c0a68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.939970:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.939972:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.939974:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.940083:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.940093:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000424d943d/0xfe91058e646c0a6f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.940101:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.940104:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.940108:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000424d943d/0xfe91058e646c0a6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.940201:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000424d943d/0xfe91058e646c0a6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.940210:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000424d943d/0xfe91058e646c0a6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.940216:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000424d943d/0xfe91058e646c0a6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.940234:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574449.940350:0:15901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574449.940356:0:15901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000424d943d/0xfe91058e646c0a6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.940364:0:15901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00031a00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574449.940368:0:15901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000424d943d/0xfe91058e646c0a6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.940377:0:15901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000424d943d/0xfe91058e646c0a6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.940389:0:15901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000424d943d/0xfe91058e646c0a6f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.940408:0:15901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000424d943d/0xfe91058e646c0a6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.940422:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.940424:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.940427:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.940892:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.940899:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058b74a16/0xfe91058e646c0a76 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.940909:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.940912:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.940917:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058b74a16/0xfe91058e646c0a76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.941001:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058b74a16/0xfe91058e646c0a76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.941018:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058b74a16/0xfe91058e646c0a76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.941026:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058b74a16/0xfe91058e646c0a76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.941042:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574449.941054:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574449.941058:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058b74a16/0xfe91058e646c0a76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.941066:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00031400 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574449.941070:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058b74a16/0xfe91058e646c0a76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.941078:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058b74a16/0xfe91058e646c0a76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.941091:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058b74a16/0xfe91058e646c0a76 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.941098:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058b74a16/0xfe91058e646c0a76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.941123:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.941133:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.941135:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.941612:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.941619:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ca72592/0xfe91058e646c0a7d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.941628:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.941631:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.941635:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ca72592/0xfe91058e646c0a7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.941644:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ca72592/0xfe91058e646c0a7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.941652:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ca72592/0xfe91058e646c0a7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.941658:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ca72592/0xfe91058e646c0a7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.941678:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574449.941797:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574449.941804:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ca72592/0xfe91058e646c0a7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.941812:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030c00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574449.941816:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ca72592/0xfe91058e646c0a7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.941823:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ca72592/0xfe91058e646c0a7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.941835:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ca72592/0xfe91058e646c0a7d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.941908:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ca72592/0xfe91058e646c0a7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.941926:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.941928:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.941930:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.943331:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.943348:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000224215e/0xfe91058e646c0a84 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.943363:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.943368:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.943373:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000224215e/0xfe91058e646c0a84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.943394:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000224215e/0xfe91058e646c0a84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.943405:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000224215e/0xfe91058e646c0a84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.943413:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000224215e/0xfe91058e646c0a84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.943432:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787574449.943891:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.943897:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072be8266/0xfe91058e646c0a8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.943906:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.943910:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.943914:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072be8266/0xfe91058e646c0a8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944006:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072be8266/0xfe91058e646c0a8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944017:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072be8266/0xfe91058e646c0a8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944036:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072be8266/0xfe91058e646c0a8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944059:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787574449.944492:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.944498:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081d6a286/0xfe91058e646c0a92 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944508:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.944511:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.944515:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081d6a286/0xfe91058e646c0a92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944525:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081d6a286/0xfe91058e646c0a92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944534:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081d6a286/0xfe91058e646c0a92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944542:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081d6a286/0xfe91058e646c0a92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944558:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787574449.944570:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787574449.944576:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000224215e/0xfe91058e646c0a84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944591:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030a00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574449.944597:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000224215e/0xfe91058e646c0a84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944606:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000224215e/0xfe91058e646c0a84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944625:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000224215e/0xfe91058e646c0a84 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944633:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000224215e/0xfe91058e646c0a84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944653:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574449.944657:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072be8266/0xfe91058e646c0a8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944663:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00031c00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574449.944666:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072be8266/0xfe91058e646c0a8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944674:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072be8266/0xfe91058e646c0a8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944686:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072be8266/0xfe91058e646c0a8b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944699:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072be8266/0xfe91058e646c0a8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944713:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574449.944716:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081d6a286/0xfe91058e646c0a92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944724:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00031200 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574449.944727:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081d6a286/0xfe91058e646c0a92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944734:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081d6a286/0xfe91058e646c0a92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944744:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081d6a286/0xfe91058e646c0a92 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944752:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081d6a286/0xfe91058e646c0a92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.944764:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.944765:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.944767:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.944776:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574449.945032:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.945498:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.945512:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8642f0/0xfe91058e646c0a99 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.945522:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.945527:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.945531:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b8642f0/0xfe91058e646c0a99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.945543:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b8642f0/0xfe91058e646c0a99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.945553:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8642f0/0xfe91058e646c0a99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.945561:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b8642f0/0xfe91058e646c0a99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.945586:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787574449.946007:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574449.946014:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b8642f0/0xfe91058e646c0a99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.946029:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a00030000 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574449.946033:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8642f0/0xfe91058e646c0a99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.946043:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8642f0/0xfe91058e646c0a99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.946061:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b8642f0/0xfe91058e646c0a99 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.946069:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b8642f0/0xfe91058e646c0a99 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.946089:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574449.946091:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574449.946092:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.946148:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.946154:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003241d90c/0xfe91058e646c0aa0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.946161:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.946376:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.946381:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003241d90c/0xfe91058e646c0aa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.946391:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003241d90c/0xfe91058e646c0aa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.946406:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003241d90c/0xfe91058e646c0aa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.946413:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003241d90c/0xfe91058e646c0aa0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.946475:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787574449.946957:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.946963:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2f02d11/0xfe91058e646c0aa7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.946972:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.946975:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.946979:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2f02d11/0xfe91058e646c0aa7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.946990:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2f02d11/0xfe91058e646c0aa7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.946999:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2f02d11/0xfe91058e646c0aa7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.947006:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2f02d11/0xfe91058e646c0aa7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.947049:0:15901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787574449.947057:0:15901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003241d90c/0xfe91058e646c0aa0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.947065:0:15901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00e00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574449.947069:0:15901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003241d90c/0xfe91058e646c0aa0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.947078:0:15901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003241d90c/0xfe91058e646c0aa0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.947092:0:15901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003241d90c/0xfe91058e646c0aa0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.947100:0:15901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003241d90c/0xfe91058e646c0aa0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.947127:0:15901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574449.947131:0:15901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2f02d11/0xfe91058e646c0aa7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.947137:0:15901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01400 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574449.947141:0:15901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2f02d11/0xfe91058e646c0aa7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.947148:0:15901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2f02d11/0xfe91058e646c0aa7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.947195:0:15901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2f02d11/0xfe91058e646c0aa7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.947204:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.947206:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.947208:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.947307:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787574449.947313:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2f02d11/0xfe91058e646c0aa7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.947334:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.947842:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.947848:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008864d6ad/0xfe91058e646c0aae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.947857:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.947860:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.947865:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008864d6ad/0xfe91058e646c0aae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.947875:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008864d6ad/0xfe91058e646c0aae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.947884:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008864d6ad/0xfe91058e646c0aae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.947892:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008864d6ad/0xfe91058e646c0aae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.947909:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574449.947921:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574449.947930:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008864d6ad/0xfe91058e646c0aae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.947938:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01800 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574449.947941:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008864d6ad/0xfe91058e646c0aae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.947949:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008864d6ad/0xfe91058e646c0aae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.947961:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008864d6ad/0xfe91058e646c0aae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.947969:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008864d6ad/0xfe91058e646c0aae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.947982:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.947984:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.947986:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.948489:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.948496:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c455e918/0xfe91058e646c0ab5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.948505:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.948508:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.948513:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c455e918/0xfe91058e646c0ab5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.948534:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c455e918/0xfe91058e646c0ab5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.948543:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c455e918/0xfe91058e646c0ab5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.948551:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c455e918/0xfe91058e646c0ab5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.948566:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574449.948575:0:15901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574449.948579:0:15901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c455e918/0xfe91058e646c0ab5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.948585:0:15901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00000 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574449.948589:0:15901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c455e918/0xfe91058e646c0ab5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.948597:0:15901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c455e918/0xfe91058e646c0ab5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.948608:0:15901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c455e918/0xfe91058e646c0ab5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.948615:0:15901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c455e918/0xfe91058e646c0ab5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.948634:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.948636:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.948637:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.949504:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.949516:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008880d0b0/0xfe91058e646c0abc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.949529:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.949532:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.949538:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008880d0b0/0xfe91058e646c0abc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.949550:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008880d0b0/0xfe91058e646c0abc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.949559:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008880d0b0/0xfe91058e646c0abc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.949567:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008880d0b0/0xfe91058e646c0abc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.949625:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787574449.950123:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.950131:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9cd663e/0xfe91058e646c0ac3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.950150:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.950154:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.950158:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9cd663e/0xfe91058e646c0ac3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.950189:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9cd663e/0xfe91058e646c0ac3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.950197:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9cd663e/0xfe91058e646c0ac3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.950205:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9cd663e/0xfe91058e646c0ac3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.950324:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787574449.950333:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008880d0b0/0xfe91058e646c0abc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.950342:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00800 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574449.950347:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008880d0b0/0xfe91058e646c0abc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.950356:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008880d0b0/0xfe91058e646c0abc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.950374:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008880d0b0/0xfe91058e646c0abc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.950382:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008880d0b0/0xfe91058e646c0abc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.950399:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574449.950403:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9cd663e/0xfe91058e646c0ac3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.950421:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01600 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574449.950424:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9cd663e/0xfe91058e646c0ac3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.950432:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9cd663e/0xfe91058e646c0ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.950444:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9cd663e/0xfe91058e646c0ac3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.950462:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.950464:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.950466:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.950539:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787574449.950544:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9cd663e/0xfe91058e646c0ac3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787574449.951070:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.951077:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb25b71a/0xfe91058e646c0aca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.951087:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.951090:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.951094:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb25b71a/0xfe91058e646c0aca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.951197:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb25b71a/0xfe91058e646c0aca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.951208:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb25b71a/0xfe91058e646c0aca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.951216:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb25b71a/0xfe91058e646c0aca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.951278:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574449.951285:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb25b71a/0xfe91058e646c0aca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.951292:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d00a00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574449.951295:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb25b71a/0xfe91058e646c0aca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.951305:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb25b71a/0xfe91058e646c0aca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.951318:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb25b71a/0xfe91058e646c0aca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.951333:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.951334:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.951337:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.951404:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787574449.951409:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb25b71a/0xfe91058e646c0aca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787574449.951935:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.951942:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060cb9c6f/0xfe91058e646c0ad1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.951952:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.951955:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.951959:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060cb9c6f/0xfe91058e646c0ad1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.951969:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060cb9c6f/0xfe91058e646c0ad1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.951990:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060cb9c6f/0xfe91058e646c0ad1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.951998:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060cb9c6f/0xfe91058e646c0ad1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.952031:0:15901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574449.952038:0:15901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060cb9c6f/0xfe91058e646c0ad1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.952046:0:15901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01a00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574449.952049:0:15901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060cb9c6f/0xfe91058e646c0ad1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.952057:0:15901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060cb9c6f/0xfe91058e646c0ad1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.952071:0:15901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060cb9c6f/0xfe91058e646c0ad1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.952079:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.952080:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.952082:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.952247:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787574449.952252:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060cb9c6f/0xfe91058e646c0ad1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787574449.952821:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.952829:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b304fe72/0xfe91058e646c0ad8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.952838:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.952843:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.952847:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b304fe72/0xfe91058e646c0ad8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.952858:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b304fe72/0xfe91058e646c0ad8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.952867:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b304fe72/0xfe91058e646c0ad8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.952887:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b304fe72/0xfe91058e646c0ad8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.952923:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574449.952928:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b304fe72/0xfe91058e646c0ad8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.952936:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01c00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574449.952939:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b304fe72/0xfe91058e646c0ad8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.952952:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b304fe72/0xfe91058e646c0ad8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.952965:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b304fe72/0xfe91058e646c0ad8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.952974:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.952976:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.952977:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.953039:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787574449.953044:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b304fe72/0xfe91058e646c0ad8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787574449.953483:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.953488:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003422bd76/0xfe91058e646c0adf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.953498:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.953500:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.953504:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003422bd76/0xfe91058e646c0adf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.953513:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003422bd76/0xfe91058e646c0adf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.953521:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003422bd76/0xfe91058e646c0adf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.953528:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003422bd76/0xfe91058e646c0adf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.953663:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574449.953669:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003422bd76/0xfe91058e646c0adf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.953678:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01200 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574449.953681:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003422bd76/0xfe91058e646c0adf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.953689:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003422bd76/0xfe91058e646c0adf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.953702:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003422bd76/0xfe91058e646c0adf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.953857:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.953860:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.953862:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.953926:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787574449.953931:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003422bd76/0xfe91058e646c0adf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787574449.954399:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.954407:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f56f1600/0xfe91058e646c0ae6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.954417:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.954420:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.954425:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f56f1600/0xfe91058e646c0ae6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.954435:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f56f1600/0xfe91058e646c0ae6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.954443:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f56f1600/0xfe91058e646c0ae6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.954461:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f56f1600/0xfe91058e646c0ae6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.955030:0:15901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574449.955038:0:15901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f56f1600/0xfe91058e646c0ae6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.955047:0:15901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a41d01000 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574449.955051:0:15901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f56f1600/0xfe91058e646c0ae6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.955060:0:15901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f56f1600/0xfe91058e646c0ae6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.955076:0:15901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f56f1600/0xfe91058e646c0ae6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.955426:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.955429:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.955431:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.956099:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787574449.956111:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f56f1600/0xfe91058e646c0ae6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574449.957225:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.959013:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.959028:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000325bb450/0xfe91058e646c0aed lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.959049:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.959054:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.959061:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000325bb450/0xfe91058e646c0aed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.959078:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000325bb450/0xfe91058e646c0aed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.959089:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000325bb450/0xfe91058e646c0aed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.959097:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000325bb450/0xfe91058e646c0aed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.959118:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574449.959133:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574449.959139:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000325bb450/0xfe91058e646c0aed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.959147:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a048f6200 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574449.959153:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000325bb450/0xfe91058e646c0aed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.959201:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000325bb450/0xfe91058e646c0aed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.959221:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000325bb450/0xfe91058e646c0aed lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.959229:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000325bb450/0xfe91058e646c0aed lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.959251:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.959253:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.959255:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.960072:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.960082:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ec0444d/0xfe91058e646c0af4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.960094:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.960097:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.960102:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ec0444d/0xfe91058e646c0af4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.960197:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ec0444d/0xfe91058e646c0af4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.960210:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ec0444d/0xfe91058e646c0af4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.960228:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ec0444d/0xfe91058e646c0af4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574449.961021:0:15901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574449.961030:0:15901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ec0444d/0xfe91058e646c0af4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574449.961041:0:15901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a048f6400 already unused, calling callback (ffffffffc142f230) 00010000:00010000:3.0:1787574449.961046:0:15901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ec0444d/0xfe91058e646c0af4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574449.961056:0:15901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ec0444d/0xfe91058e646c0af4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574449.961081:0:15901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ec0444d/0xfe91058e646c0af4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574449.961090:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574449.961092:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574449.961093:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574449.961114:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787574449.961121:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ec0444d/0xfe91058e646c0af4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787574449.963556:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.963570:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c35b510a/0xfe91058e646c0afb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787574449.963588:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1787574449.963590:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.963595:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.963601:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c35b510a/0xfe91058e646c0afb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.963625:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c35b510a/0xfe91058e646c0afb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.963637:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c35b510a/0xfe91058e646c0afb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.963645:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c35b510a/0xfe91058e646c0afb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.963680:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574449.963800:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574449.963808:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c35b510a/0xfe91058e646c0afb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.963817:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a048f7a00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574449.963822:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c35b510a/0xfe91058e646c0afb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.963831:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c35b510a/0xfe91058e646c0afb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.963863:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c35b510a/0xfe91058e646c0afb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.963870:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c35b510a/0xfe91058e646c0afb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.963892:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.963894:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.963895:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.964295:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.964303:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054f72c2d/0xfe91058e646c0b02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.964312:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.964316:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.964320:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054f72c2d/0xfe91058e646c0b02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.964329:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054f72c2d/0xfe91058e646c0b02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.964338:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054f72c2d/0xfe91058e646c0b02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.964346:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054f72c2d/0xfe91058e646c0b02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.964369:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574449.964479:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574449.964485:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054f72c2d/0xfe91058e646c0b02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.964494:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a048f7600 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574449.964498:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054f72c2d/0xfe91058e646c0b02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.964506:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054f72c2d/0xfe91058e646c0b02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.964518:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054f72c2d/0xfe91058e646c0b02 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.964526:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054f72c2d/0xfe91058e646c0b02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.964553:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.964555:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.964557:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.964804:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.964811:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc51d1c3/0xfe91058e646c0b09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.964820:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.964830:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.964835:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc51d1c3/0xfe91058e646c0b09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.964915:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc51d1c3/0xfe91058e646c0b09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.964987:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc51d1c3/0xfe91058e646c0b09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.964997:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc51d1c3/0xfe91058e646c0b09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.965020:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574449.965257:0:15901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574449.965264:0:15901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc51d1c3/0xfe91058e646c0b09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.965273:0:15901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a048f6000 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574449.965277:0:15901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc51d1c3/0xfe91058e646c0b09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.965286:0:15901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc51d1c3/0xfe91058e646c0b09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.965298:0:15901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc51d1c3/0xfe91058e646c0b09 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.965305:0:15901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc51d1c3/0xfe91058e646c0b09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.965321:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.965323:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.965324:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.965482:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.965488:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee260752/0xfe91058e646c0b10 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.965497:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.965501:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.965505:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee260752/0xfe91058e646c0b10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.965516:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee260752/0xfe91058e646c0b10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.965524:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee260752/0xfe91058e646c0b10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.965536:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee260752/0xfe91058e646c0b10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.965557:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574449.965799:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574449.965805:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee260752/0xfe91058e646c0b10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.965825:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a048f6c00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574449.965829:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee260752/0xfe91058e646c0b10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.965837:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee260752/0xfe91058e646c0b10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.965848:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee260752/0xfe91058e646c0b10 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.965856:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee260752/0xfe91058e646c0b10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.965871:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.965873:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.965875:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.966105:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.966112:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eab9dbfc/0xfe91058e646c0b17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.966121:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.966125:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.966129:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eab9dbfc/0xfe91058e646c0b17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.966138:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eab9dbfc/0xfe91058e646c0b17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.966146:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eab9dbfc/0xfe91058e646c0b17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.966153:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eab9dbfc/0xfe91058e646c0b17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.966190:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574449.966243:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574449.966248:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eab9dbfc/0xfe91058e646c0b17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.966256:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a048f7c00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574449.966259:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eab9dbfc/0xfe91058e646c0b17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.966267:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eab9dbfc/0xfe91058e646c0b17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.966285:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eab9dbfc/0xfe91058e646c0b17 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.966293:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eab9dbfc/0xfe91058e646c0b17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.966308:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.966310:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.966312:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.966583:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.966589:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d11579b8/0xfe91058e646c0b1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.966601:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.966604:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.966608:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d11579b8/0xfe91058e646c0b1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.966618:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d11579b8/0xfe91058e646c0b1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.966625:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d11579b8/0xfe91058e646c0b1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.966634:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d11579b8/0xfe91058e646c0b1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.966656:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787574449.966797:0:15901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574449.966805:0:15901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d11579b8/0xfe91058e646c0b1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.966812:0:15901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a048f7400 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574449.966816:0:15901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d11579b8/0xfe91058e646c0b1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.966824:0:15901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d11579b8/0xfe91058e646c0b1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.966843:0:15901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d11579b8/0xfe91058e646c0b1e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.966852:0:15901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d11579b8/0xfe91058e646c0b1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574449.966869:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574449.966870:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574449.966872:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574449.967185:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787574449.967191:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068759d09/0xfe91058e646c0b25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.967199:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1787574449.967202:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574449.967206:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068759d09/0xfe91058e646c0b25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.967215:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068759d09/0xfe91058e646c0b25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.967234:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068759d09/0xfe91058e646c0b25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.967242:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068759d09/0xfe91058e646c0b25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574449.967254:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787574449.967403:0:15009:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1787574449.967534:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14349:x1874407290144512:12345-0@lo:5:osp-pre-1-0.0 Request processed in 35458us (107377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574449.967544:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787574449.967590:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787574449.967602:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14347:x1874407290144640:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787574449.967653:0:15009:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1787574449.967863:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14349:1874407290144512:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787574449.967881:0:14349:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787574449.967942:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14349:1874407290144768:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787574449.967985:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574449.968021:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a180273c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574449.968050:0:15006:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787574449.968058:0:15006:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787574449.968215:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290144768 00000100:00100000:1.0:1787574449.968224:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290144768 00000100:00100000:1.0:1787574449.968326:0:15905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787574449.968332:0:15905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14349:x1874407290144768:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787574449.968355:0:15905:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1787574449.971865:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574449.971883:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068759d09/0xfe91058e646c0b25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.971901:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a048f7200 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574449.971907:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068759d09/0xfe91058e646c0b25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.971920:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068759d09/0xfe91058e646c0b25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.971948:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068759d09/0xfe91058e646c0b25 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.971956:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068759d09/0xfe91058e646c0b25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.972001:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.972003:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574449.972006:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574449.975804:0:15905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14349:x1874407290144768:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7459us (7807us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787574449.975821:0:15905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787574449.975920:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14349:1874407290144768:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787574449.975940:0:14349:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1787574449.985225:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14347:x1874407290144640:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17614us (53363us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787574449.985242:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787574449.985511:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14347:1874407290144640:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787574449.985530:0:14347:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1787574450.354954:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787574450.917924:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1787574450.917984:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787574451.377404:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574452.406836:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787574452.446257:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787574452.446282:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:02000400:2.0:1787574453.118810:0:16086:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787574453.425359:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574454.450295:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574454.897852:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2841886-4ae8-43da-bc7c-46b9b13f805e:3298:1874407290144896:0@lo:400:kworker.0 00000100:00100000:1.0:1787574454.897927:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574454.897975:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290145408:0@lo:400:kworker.0 00000100:00100000:1.0:1787574454.898002:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574454.898028:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787574454.898034:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290145024:0@lo:400:kworker.0 00000100:00100000:1.0:1787574454.898059:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574454.898076:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290145536:0@lo:400:kworker.0 00000100:00100000:1.0:1787574454.898102:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574454.898130:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290145152:0@lo:400:kworker.0 00000100:00100000:1.0:1787574454.898153:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574454.898198:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574454.898205:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874407290145280:0@lo:400:kworker.0 00000100:00100000:1.0:1787574454.898228:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574454.898554:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290144896 00000100:00100000:1.0:1787574454.898564:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290144896 00000100:00100000:2.0:1787574454.915302:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290145408 00000100:00100000:2.0:1787574454.915316:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290145408 00000100:00100000:2.0:1787574454.915379:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290145536 00000100:00100000:2.0:1787574454.915388:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290145536 00000100:00100000:2.0:1787574454.915406:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290145280 00000100:00100000:2.0:1787574454.915409:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290145280 00000100:00100000:2.0:1787574454.915437:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787574454.915448:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290145408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574454.915534:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290145408:12345-0@lo:400:kworker.0 Request processed in 88us (17531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574454.915542:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787574454.915558:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787574454.915564:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290145536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574454.915593:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290145536:12345-0@lo:400:kworker.0 Request processed in 30us (17492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574454.915611:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787574454.915622:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574454.915628:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874407290145280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574454.915696:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290145664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574454.915740:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787574454.915822:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574454.917127:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874407290145280:12345-0@lo:400:kworker.0 Request processed in 1491us (18890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574454.917139:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574454.917207:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290145024 00000100:00100000:2.0:1787574454.917213:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290145024 00000100:00100000:2.0:1787574454.917262:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290145152 00000100:00100000:2.0:1787574454.917266:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290145152 00000100:00100000:2.0:1787574454.917290:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574454.917300:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290145024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574454.917352:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290145024:12345-0@lo:400:kworker.0 Request processed in 54us (19291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574454.917384:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574454.917395:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290145152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574454.917442:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290145152:12345-0@lo:400:kworker.0 Request processed in 50us (19288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574454.917755:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574454.917763:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787574454.918626:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787574454.918633:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574454.921370:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787574454.921391:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907dec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:3298:x1874407290144896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574454.921493:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907dec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:3298:x1874407290144896:12345-0@lo:400:kworker.0 Request processed in 111us (23566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574454.921501:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787574454.921550:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3adf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290145792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574454.921586:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574454.921659:0:3298:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787574454.921676:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290145024:0@lo:400:kworker.0 00010000:00080000:2.0:1787574454.921710:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419a3800 x1874407290145536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574454.921721:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290145536:0@lo:400:kworker.0 00000100:00100000:2.0:1787574454.921731:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2841886-4ae8-43da-bc7c-46b9b13f805e:3298:1874407290144896:0@lo:400:kworker.0 00010000:00080000:2.0:1787574454.921741:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419a3100 x1874407290145408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574454.921749:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290145408:0@lo:400:kworker.0 00000100:00100000:0.0:1787574454.923490:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290145664 00000100:00100000:0.0:1787574454.923513:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290145664 00000100:00100000:0.0:1787574454.923552:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290145792 00000100:00100000:0.0:1787574454.923555:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290145792 00000100:00100000:0.0:1787574454.923573:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787574454.923583:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290145664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787574454.923620:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574454.923695:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290145664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (7954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574454.923701:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787574454.923717:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787574454.923723:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290145792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574454.923742:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574454.923780:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290145792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (2194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574454.923786:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787574454.923916:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3adf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290145792:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787574454.925772:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a419a1880 x1874407290145280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574454.925790:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874407290145280:0@lo:400:kworker.0 00000100:00100000:1.0:1787574454.925803:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787574454.925818:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290145152:0@lo:400:kworker.0 00000100:00100000:1.0:1787574454.925862:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290145664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574455.000741:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574455.000778:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272325376 00000100:00100000:1.0:1787574455.000788:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272325376 00000100:00100000:1.0:1787574455.000824:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:1.0:1787574455.000832:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907dec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2349:x1874407272325376:12345-192.168.206.51@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787574455.000856:0:14316:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6dac4a08-d60d-45ca-bc3d-721804b2f529@192.168.206.51@tcp t0 exp 0000000000000000 cur 431 last 0 00000020:00000080:1.0:1787574455.000885:0:14316:0:(genops.c:1385:class_connect()) connect: client 6dac4a08-d60d-45ca-bc3d-721804b2f529, cookie 0xfe91058e646c0b2c 00000100:00080000:1.0:1787574455.001012:0:14316:0:(import.c:65:import_set_state_nolock()) ffff98290675f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787574455.001083:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907dec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dac4a08-d60d-45ca-bc3d-721804b2f529+5:2349:x1874407272325376:12345-192.168.206.51@tcp:250:mount.lustre.0 Request processed in 243us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574455.001092:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:1.0:1787574455.008196:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574455.008986:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272325504 00000100:00100000:3.0:1787574455.008997:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272325504 00000100:00100000:3.0:1787574455.009053:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:3.0:1787574455.009062:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907ded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+5:13734:x1874407272325504:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787574455.009089:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574455.009105:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a027f3200/0xfe91058e646c0b33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eee2 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574455.009131:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a027f3200/0xfe91058e646c0b33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eee2 expref: 6 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574455.009143:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a027f3200/0xfe91058e646c0b33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eee2 expref: 6 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574455.009151:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a027f3200, rc 0) 00000100:00100000:3.0:1787574455.009226:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907ded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+6:13734:x1874407272325504:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 165us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574455.009234:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:1.0:1787574455.013468:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574455.013502:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272325632 00000100:00100000:1.0:1787574455.013511:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272325632 00000100:00100000:1.0:1787574455.013554:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:1.0:1787574455.013564:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907ded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+6:13734:x1874407272325632:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787574455.013913:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907ded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+6:13734:x1874407272325632:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 349us (452us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787574455.013921:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:3.0:1787574455.026918:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574455.026956:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272325760 00000100:00100000:3.0:1787574455.026965:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272325760 00000100:00100000:3.0:1787574455.027013:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:3.0:1787574455.027023:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907dedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dac4a08-d60d-45ca-bc3d-721804b2f529+6:13734:x1874407272325760:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787574455.027038:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574455.027058:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a027f3800/0xfe91058e646c0b3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eee9 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574455.027084:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a027f3800/0xfe91058e646c0b3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eee9 expref: 7 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574455.027094:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a027f3800/0xfe91058e646c0b3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eee9 expref: 7 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574455.027120:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a027f3800, rc 0) 00000100:00100000:3.0:1787574455.027195:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907dedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dac4a08-d60d-45ca-bc3d-721804b2f529+7:13734:x1874407272325760:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 172us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574455.027202:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:1.0:1787574455.037871:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574455.037922:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272325888 00000100:00100000:3.0:1787574455.037931:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272325888 00000100:00100000:3.0:1787574455.037985:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:3.0:1787574455.037995:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907ded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+7:13734:x1874407272325888:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787574455.038323:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907ded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+8:13734:x1874407272325888:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 328us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574455.038332:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:3.0:1787574455.040663:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574455.041432:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272326016 00000100:00100000:1.0:1787574455.041447:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272326016 00000100:00100000:1.0:1787574455.041530:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:1.0:1787574455.041540:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907dee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+8:13734:x1874407272326016:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787574455.042069:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907dee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+8:13734:x1874407272326016:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 527us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574455.042080:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:0.0:1787574455.047410:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574455.047764:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272326144 00000100:00100000:3.0:1787574455.047777:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272326144 00000100:00100000:3.0:1787574455.047854:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:3.0:1787574455.047867:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982907defc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+8:13753:x1874407272326144:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787574455.048369:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982907defc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+8:13753:x1874407272326144:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 501us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574455.048379:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:1.0:1787574455.073757:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574455.073860:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272326272 00000100:00100000:0.0:1787574455.073875:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272326272 00000100:00100000:0.0:1787574455.073942:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:0.0:1787574455.073954:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+8:13753:x1874407272326272:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787574455.074367:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+8:13753:x1874407272326272:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 413us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574455.074384:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:0.0:1787574455.082837:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574455.082952:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272326400 00000100:00100000:1.0:1787574455.082965:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272326400 00000100:00100000:1.0:1787574455.083035:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:1.0:1787574455.083047:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dac4a08-d60d-45ca-bc3d-721804b2f529+8:13734:x1874407272326400:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787574455.083069:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574455.083091:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a057e0800/0xfe91058e646c0b41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ef13 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574455.083130:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a057e0800/0xfe91058e646c0b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef13 expref: 9 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574455.083142:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a057e0800/0xfe91058e646c0b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef13 expref: 9 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574455.083153:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0800, rc 0) 00000100:00100000:1.0:1787574455.083260:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dac4a08-d60d-45ca-bc3d-721804b2f529+9:13734:x1874407272326400:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 214us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574455.083268:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:1.0:1787574455.091403:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574455.091615:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272326528 00000100:00100000:3.0:1787574455.091628:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272326528 00000100:00100000:3.0:1787574455.091694:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:3.0:1787574455.091706:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+9:13734:x1874407272326528:12345-192.168.206.51@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787574455.091739:0:14319:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787574455.091776:0:14319:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787574455.091780:0:14319:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787574455.091783:0:14319:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787574455.091786:0:14319:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787574455.093835:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+9:13734:x1874407272326528:12345-192.168.206.51@tcp:256:mount.lustre.0 Request processed in 2119us (2433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574455.093852:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:0.0:1787574455.099051:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574455.099159:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272326656 00000100:00100000:1.0:1787574455.099228:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272326656 00000100:00100000:1.0:1787574455.099310:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:1.0:1787574455.099325:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d01a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+9:13734:x1874407272326656:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787574455.099348:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574455.099372:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a057e1a00/0xfe91058e646c0b48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ef1a expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574455.099449:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a057e1a00/0xfe91058e646c0b48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef1a expref: 10 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574455.099461:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a057e1a00/0xfe91058e646c0b48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef1a expref: 10 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574455.099477:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1a00, rc 0) 00000100:00100000:1.0:1787574455.099553:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d01a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+10:13734:x1874407272326656:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 232us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574455.099561:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:1.0:1787574455.103323:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574455.103555:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272326784 00000100:00100000:3.0:1787574455.103564:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272326784 00000100:00100000:3.0:1787574455.103651:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:3.0:1787574455.103661:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d01b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+10:13734:x1874407272326784:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787574455.104019:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d01b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+10:13734:x1874407272326784:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 357us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574455.104027:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:2.0:1787574455.106185:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574455.106271:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272326912 00000100:00100000:1.0:1787574455.106280:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272326912 00000100:00100000:1.0:1787574455.106365:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:1.0:1787574455.106376:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+10:13734:x1874407272326912:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787574455.106830:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+10:13734:x1874407272326912:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 451us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574455.106844:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:0.0:1787574455.109802:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574455.110360:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272327040 00000100:00100000:3.0:1787574455.110370:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272327040 00000100:00100000:3.0:1787574455.110483:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:3.0:1787574455.110494:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d01b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+10:13757:x1874407272327040:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787574455.110770:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d01b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+10:13757:x1874407272327040:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 277us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574455.110777:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:0.0:1787574455.123840:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574455.123980:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272327168 00000100:00100000:1.0:1787574455.123991:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272327168 00000100:00100000:1.0:1787574455.124051:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:1.0:1787574455.124061:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d01bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+10:13757:x1874407272327168:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787574455.124469:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d01bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+10:13757:x1874407272327168:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 408us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574455.124477:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:2.0:1787574455.135399:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574455.135571:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272327296 00000100:00100000:0.0:1787574455.135582:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272327296 00000100:00100000:0.0:1787574455.135633:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:0.0:1787574455.135642:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2349:x1874407272327296:12345-192.168.206.51@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787574455.135668:0:14325:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from cb815d5e-9f9e-47fd-838c-222c53157044@192.168.206.51@tcp t0 exp 0000000000000000 cur 431 last 0 00000020:00000080:0.0:1787574455.135721:0:14325:0:(genops.c:1385:class_connect()) connect: client cb815d5e-9f9e-47fd-838c-222c53157044, cookie 0xfe91058e646c0b4f 00000004:00100000:0.0:1787574455.135755:0:14325:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787574455.135761:0:14325:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787574455.169544:0:14325:0:(import.c:65:import_set_state_nolock()) ffff9829063d9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574455.169620:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb815d5e-9f9e-47fd-838c-222c53157044+6:2349:x1874407272327296:12345-192.168.206.51@tcp:38:mount.lustre.0 Request processed in 33976us (34228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574455.169631:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:0.0:1787574455.174749:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574455.174826:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272327424 00000100:00100000:2.0:1787574455.174837:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272327424 00000100:00100000:2.0:1787574455.174913:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1787574455.174925:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb815d5e-9f9e-47fd-838c-222c53157044+6:0:x1874407272327424:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787574455.174966:0:14324:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787574455.175054:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb815d5e-9f9e-47fd-838c-222c53157044+6:0:x1874407272327424:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 131us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574455.175061:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00080000:3.0:1787574455.175656:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574455.175734:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574455.175793:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272327552 00000100:00100000:2.0:1787574455.175804:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272327552 00000100:00100000:2.0:1787574455.175840:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:2.0:1787574455.175848:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb815d5e-9f9e-47fd-838c-222c53157044+6:13734:x1874407272327552:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787574455.175864:0:15671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787574455.176016:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb815d5e-9f9e-47fd-838c-222c53157044+6:13734:x1874407272327552:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 168us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574455.176024:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:0.0:1787574455.183025:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574455.184295:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272327680 00000100:00100000:2.0:1787574455.184307:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272327680 00000100:00100000:2.0:1787574455.184368:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:2.0:1787574455.184378:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb815d5e-9f9e-47fd-838c-222c53157044+6:13734:x1874407272327680:12345-192.168.206.51@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787574455.184536:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb815d5e-9f9e-47fd-838c-222c53157044+6:13734:x1874407272327680:12345-192.168.206.51@tcp:40:mount.lustre.0 Request processed in 159us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574455.184542:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:0.0:1787574455.186832:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574455.186870:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574455.186968:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574455.187042:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272328064 00000100:00100000:1.0:1787574455.187052:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272328064 00000100:00100000:1.0:1787574455.187111:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:1.0:1787574455.187121:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cb815d5e-9f9e-47fd-838c-222c53157044+6:13734:x1874407272328064:12345-192.168.206.51@tcp:33:mount.lustre.0 00000004:00080000:0.0:1787574455.187977:0:14327:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 775us 00000100:00100000:2.0:1787574455.190998:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272327808 00000100:00100000:2.0:1787574455.191010:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272327808 00000100:00100000:2.0:1787574455.191044:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272327936 00000100:00100000:2.0:1787574455.191048:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272327936 00000100:00100000:2.0:1787574455.191070:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:2.0:1787574455.191079:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1874407272327808:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787574455.191116:0:15008:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from cb815d5e-9f9e-47fd-838c-222c53157044@192.168.206.51@tcp t0 exp 0000000000000000 cur 431 last 0 00000020:00000080:2.0:1787574455.191145:0:15008:0:(genops.c:1385:class_connect()) connect: client cb815d5e-9f9e-47fd-838c-222c53157044, cookie 0xfe91058e646c0b56 00002000:00100000:2.0:1787574455.191156:0:15008:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cb815d5e-9f9e-47fd-838c-222c53157044/ffff9829046fc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787574455.191180:0:15008:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787574455.191696:0:15008:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787574455.191730:0:15008:0:(import.c:65:import_set_state_nolock()) ffff9829046ff000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574455.191794:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb815d5e-9f9e-47fd-838c-222c53157044+6:2349:x1874407272327808:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 715us (4970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574455.191802:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:2.0:1787574455.191821:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:2.0:1787574455.191835:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1874407272327936:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787574455.191851:0:15008:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from cb815d5e-9f9e-47fd-838c-222c53157044@192.168.206.51@tcp t0 exp 0000000000000000 cur 431 last 0 00000020:00000080:2.0:1787574455.191872:0:15008:0:(genops.c:1385:class_connect()) connect: client cb815d5e-9f9e-47fd-838c-222c53157044, cookie 0xfe91058e646c0b5d 00002000:00100000:2.0:1787574455.191879:0:15008:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cb815d5e-9f9e-47fd-838c-222c53157044/ffff9829046fd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787574455.191886:0:15008:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787574455.192248:0:15008:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787574455.192265:0:15008:0:(import.c:65:import_set_state_nolock()) ffff9829046fe000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574455.192293:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb815d5e-9f9e-47fd-838c-222c53157044+6:2349:x1874407272327936:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 457us (5325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574455.192300:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000004:00200000:0.0:1787574455.205085:0:14327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787574455.205522:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cb815d5e-9f9e-47fd-838c-222c53157044+6:13734:x1874407272328064:12345-192.168.206.51@tcp:33:mount.lustre.0 Request processed in 18398us (18646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574455.205536:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:0.0:1787574455.368915:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574455.369002:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272328192 00000100:00100000:2.0:1787574455.369012:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272328192 00000100:00100000:2.0:1787574455.369077:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:2.0:1787574455.369088:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3adf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb815d5e-9f9e-47fd-838c-222c53157044+6:13778:x1874407272328192:12345-192.168.206.51@tcp:101:mkdir.0 00010000:00010000:2.0:1787574455.369118:0:15671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574455.369143:0:15671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c0b64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ef44 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574455.369252:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c0b6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574455.369278:0:15671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c0b6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574455.369294:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c0b6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574455.369518:0:15671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787574455.369522:0:15671:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787574455.369613:0:15671:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c0b6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574455.369642:0:15671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c0b64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef44 expref: 8 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574455.369659:0:15671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c0b6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef44 expref: 7 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574455.369667:0:15671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34500) 00010000:00010000:2.0:1787574455.369670:0:15671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787574455.369673:0:15671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fb400, rc 0) 00000100:00100000:2.0:1787574455.369727:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3adf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb815d5e-9f9e-47fd-838c-222c53157044+7:13778:x1874407272328192:12345-192.168.206.51@tcp:101:mkdir.0 Request processed in 641us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574455.369734:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00010000:00010000:0.0:1787574455.473754:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787574455.961670:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cb815d5e-9f9e-47fd-838c-222c53157044 00010000:00010000:3.0:1787574456.497750:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787574456.881836:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787574457.351627:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574457.353357:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272328320 00000100:00100000:2.0:1787574457.353372:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272328320 00000100:00100000:2.0:1787574457.353474:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:2.0:1787574457.353484:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb815d5e-9f9e-47fd-838c-222c53157044+7:13830:x1874407272328320:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:2.0:1787574457.353524:0:14325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787574457.353749:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb815d5e-9f9e-47fd-838c-222c53157044+7:13830:x1874407272328320:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 265us (2203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574457.353758:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00080000:3.0:1787574457.354094:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574457.367955:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574457.369395:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272328448 00000100:00100000:0.0:1787574457.369418:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272328448 00000100:00100000:0.0:1787574457.369508:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:0.0:1787574457.369519:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cb815d5e-9f9e-47fd-838c-222c53157044+5:13830:x1874407272328448:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:0.0:1787574457.369569:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574457.369664:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cb815d5e-9f9e-47fd-838c-222c53157044+5:13830:x1874407272328448:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 147us (1716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574457.369671:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00080000:3.0:1787574457.370121:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574457.373762:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574457.373858:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272328576 00000100:00100000:0.0:1787574457.373878:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272328576 00000100:00100000:0.0:1787574457.373943:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:0.0:1787574457.373953:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cb815d5e-9f9e-47fd-838c-222c53157044+6:13830:x1874407272328576:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:0.0:1787574457.373989:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574457.374078:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cb815d5e-9f9e-47fd-838c-222c53157044+6:13830:x1874407272328576:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 127us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574457.374086:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00080000:3.0:1787574457.374382:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1787574457.519677:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cb815d5e-9f9e-47fd-838c-222c53157044 00010000:00010000:1.0:1787574457.521544:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574457.558986:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574457.559099:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272328704 00000100:00100000:3.0:1787574457.559116:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272328704 00000100:00100000:1.0:1787574457.559341:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:1.0:1787574457.559354:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dac4a08-d60d-45ca-bc3d-721804b2f529+10:13859:x1874407272328704:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787574457.559369:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574457.559385:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a057e0600/0xfe91058e646c0b72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ef4b expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574457.559421:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a057e0600/0xfe91058e646c0b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef4b expref: 11 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574457.559432:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a057e0600/0xfe91058e646c0b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef4b expref: 11 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574457.559440:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0600, rc 0) 00000100:00100000:1.0:1787574457.559496:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dac4a08-d60d-45ca-bc3d-721804b2f529+11:13859:x1874407272328704:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 144us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574457.559503:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:2.0:1787574457.564904:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574457.564998:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272328832 00000100:00100000:1.0:1787574457.565007:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272328832 00000100:00100000:1.0:1787574457.565073:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:1.0:1787574457.565083:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d01a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+11:13859:x1874407272328832:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787574457.567032:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d01a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+11:13859:x1874407272328832:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 1943us (2128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574457.567046:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:0.0:1787574457.574261:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574457.574416:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272328960 00000100:00100000:2.0:1787574457.574426:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272328960 00000100:00100000:2.0:1787574457.574481:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:2.0:1787574457.574491:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+11:13859:x1874407272328960:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787574457.574853:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+11:13859:x1874407272328960:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 362us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574457.574861:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:2.0:1787574457.579280:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574457.579477:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272329088 00000100:00100000:1.0:1787574457.579486:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272329088 00000100:00100000:1.0:1787574457.579538:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:1.0:1787574457.579560:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d01b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+11:13867:x1874407272329088:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787574457.579929:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d01b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+11:13867:x1874407272329088:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 380us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574457.579937:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:1.0:1787574457.612688:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574457.616351:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272329216 00000100:00100000:3.0:1787574457.616368:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272329216 00000100:00100000:3.0:1787574457.616452:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:3.0:1787574457.616471:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3d019050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dac4a08-d60d-45ca-bc3d-721804b2f529+11:13867:x1874407272329216:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787574457.616902:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3d019050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dac4a08-d60d-45ca-bc3d-721804b2f529+11:13867:x1874407272329216:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 431us (4222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574457.616911:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:0.0:1787574457.631806:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574457.633148:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272329344 00000100:00100000:2.0:1787574457.633213:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272329344 00000100:00100000:2.0:1787574457.633305:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:2.0:1787574457.633319:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+11:13859:x1874407272329344:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787574457.633342:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574457.633368:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a069fa200/0xfe91058e646c0b79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ef75 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574457.633416:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a069fa200/0xfe91058e646c0b79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef75 expref: 12 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574457.633430:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a069fa200/0xfe91058e646c0b79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef75 expref: 12 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574457.633451:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fa200, rc 0) 00000100:00100000:2.0:1787574457.633529:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+12:13859:x1874407272329344:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 213us (1736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574457.633537:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:2.0:1787574457.636573:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574457.636848:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272329472 00000100:00100000:1.0:1787574457.636865:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272329472 00000100:00100000:1.0:1787574457.636932:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:1.0:1787574457.636943:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+12:13859:x1874407272329472:12345-192.168.206.51@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787574457.636968:0:14318:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787574457.636991:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787574457.636996:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787574457.636999:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787574457.637001:0:14318:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787574457.642954:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+12:13859:x1874407272329472:12345-192.168.206.51@tcp:256:mount.lustre.0 Request processed in 5996us (6376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574457.642985:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:0.0:1787574457.647137:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574457.647435:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272329600 00000100:00100000:2.0:1787574457.647449:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272329600 00000100:00100000:2.0:1787574457.647517:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:2.0:1787574457.647528:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+12:13859:x1874407272329600:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787574457.647549:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574457.647572:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a069fb200/0xfe91058e646c0b80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1ef7c expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574457.647608:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a069fb200/0xfe91058e646c0b80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef7c expref: 13 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574457.647621:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a069fb200/0xfe91058e646c0b80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef7c expref: 13 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574457.647631:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fb200, rc 0) 00000100:00100000:2.0:1787574457.647711:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+13:13859:x1874407272329600:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 184us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574457.647719:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:2.0:1787574457.649780:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574457.649887:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272329728 00000100:00100000:0.0:1787574457.649898:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272329728 00000100:00100000:0.0:1787574457.649961:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:0.0:1787574457.649973:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+13:13859:x1874407272329728:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787574457.650394:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+13:13859:x1874407272329728:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 422us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574457.650403:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:1.0:1787574457.652658:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574457.652757:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272329856 00000100:00100000:3.0:1787574457.652775:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272329856 00000100:00100000:3.0:1787574457.652835:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00100000:3.0:1787574457.652844:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dac4a08-d60d-45ca-bc3d-721804b2f529+13:13859:x1874407272329856:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787574457.653277:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dac4a08-d60d-45ca-bc3d-721804b2f529+13:13859:x1874407272329856:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 432us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574457.653287:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00100000:1.0:1787574457.657249:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574457.657503:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272329984 00000100:00100000:2.0:1787574457.657515:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272329984 00000100:00100000:2.0:1787574457.657576:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:2.0:1787574457.657587:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+13:13873:x1874407272329984:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787574457.657945:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+13:13873:x1874407272329984:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 359us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574457.657954:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:2.0:1787574457.668036:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574457.668217:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272330112 00000100:00100000:0.0:1787574457.668229:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272330112 00000100:00100000:0.0:1787574457.668294:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:0.0:1787574457.668307:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+13:13873:x1874407272330112:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787574457.668635:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+13:13873:x1874407272330112:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 330us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574457.668644:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:1.0:1787574457.674916:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574457.674962:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574457.675016:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574457.675052:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574457.675101:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272330624 00000100:00100000:1.0:1787574457.675113:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272330624 00000100:00100000:1.0:1787574457.675216:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272330240 00000100:00100000:1.0:1787574457.675220:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272330240 00000100:00100000:1.0:1787574457.675262:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:1.0:1787574457.675276:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb815d5e-9f9e-47fd-838c-222c53157044+7:2353:x1874407272330624:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574457.675373:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb815d5e-9f9e-47fd-838c-222c53157044+7:2353:x1874407272330624:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 101us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574457.675381:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:1.0:1787574457.675400:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:1.0:1787574457.675413:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2349:x1874407272330240:12345-192.168.206.51@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787574457.675441:0:14326:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 30990db0-f016-4bad-afb0-413c8b48dde7@192.168.206.51@tcp t0 exp 0000000000000000 cur 433 last 0 00000020:00000080:1.0:1787574457.675495:0:14326:0:(genops.c:1385:class_connect()) connect: client 30990db0-f016-4bad-afb0-413c8b48dde7, cookie 0xfe91058e646c0b87 00000004:00100000:1.0:1787574457.675534:0:14326:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787574457.675696:0:14326:0:(import.c:65:import_set_state_nolock()) ffff982a03570000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787574457.675731:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30990db0-f016-4bad-afb0-413c8b48dde7+6:2349:x1874407272330240:12345-192.168.206.51@tcp:38:mount.lustre.0 Request processed in 324us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574457.675738:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:0.0:1787574457.677562:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272330752 00000100:00100000:0.0:1787574457.677578:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272330752 00000100:00100000:0.0:1787574457.677640:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272330880 00000100:00100000:0.0:1787574457.677644:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272330880 00000100:00100000:0.0:1787574457.677685:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:0.0:1787574457.677696:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb815d5e-9f9e-47fd-838c-222c53157044+5:2352:x1874407272330752:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574457.677770:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb815d5e-9f9e-47fd-838c-222c53157044+5:2352:x1874407272330752:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 76us (2806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574457.677777:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:0.0:1787574457.677809:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:0.0:1787574457.677815:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb815d5e-9f9e-47fd-838c-222c53157044+5:2353:x1874407272330880:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574457.677838:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb815d5e-9f9e-47fd-838c-222c53157044+5:2353:x1874407272330880:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 23us (2823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574457.677844:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:1.0:1787574457.684138:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574457.684283:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272330368 00000100:00100000:2.0:1787574457.684296:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272330368 00000100:00100000:1.0:1787574457.684426:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574457.684543:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272330496 00000100:00100000:2.0:1787574457.684548:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272330496 00000100:00100000:2.0:1787574457.684581:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:2.0:1787574457.684594:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30990db0-f016-4bad-afb0-413c8b48dde7+7:0:x1874407272330368:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787574457.684634:0:14326:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787574457.684725:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30990db0-f016-4bad-afb0-413c8b48dde7+7:0:x1874407272330368:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 133us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574457.684734:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:2.0:1787574457.684754:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:2.0:1787574457.684761:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30990db0-f016-4bad-afb0-413c8b48dde7+6:13859:x1874407272330496:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787574457.684772:0:14326:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787574457.684796:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30990db0-f016-4bad-afb0-413c8b48dde7+6:13859:x1874407272330496:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 35us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574457.684803:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00080000:3.0:1787574457.688839:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574457.689432:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574457.689533:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272331008 00000100:00100000:1.0:1787574457.689546:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272331008 00000100:00100000:1.0:1787574457.689626:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1787574457.689639:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30990db0-f016-4bad-afb0-413c8b48dde7+6:13859:x1874407272331008:12345-192.168.206.51@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787574457.689779:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30990db0-f016-4bad-afb0-413c8b48dde7+6:13859:x1874407272331008:12345-192.168.206.51@tcp:40:mount.lustre.0 Request processed in 143us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574457.689788:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:2.0:1787574457.693717:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574457.693805:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272331392 00000100:00100000:0.0:1787574457.693818:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272331392 00000100:00100000:2.0:1787574457.693823:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574457.693950:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272331136 00000100:00100000:3.0:1787574457.693955:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272331136 00000100:00100000:3.0:1787574457.693999:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1787574457.694009:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1874407272331136:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787574457.694101:0:15009:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 30990db0-f016-4bad-afb0-413c8b48dde7@192.168.206.51@tcp t0 exp 0000000000000000 cur 433 last 0 00000020:00000080:3.0:1787574457.694139:0:15009:0:(genops.c:1385:class_connect()) connect: client 30990db0-f016-4bad-afb0-413c8b48dde7, cookie 0xfe91058e646c0b8e 00002000:00100000:3.0:1787574457.694153:0:15009:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 30990db0-f016-4bad-afb0-413c8b48dde7/ffff98290808e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787574457.694210:0:15009:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787574457.694532:0:15009:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787574457.694583:0:15009:0:(import.c:65:import_set_state_nolock()) ffff982908088000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787574457.694671:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30990db0-f016-4bad-afb0-413c8b48dde7+6:2349:x1874407272331136:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 660us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574457.694680:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:2.0:1787574457.695112:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574457.697613:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:0.0:1787574457.697645:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30990db0-f016-4bad-afb0-413c8b48dde7+6:13859:x1874407272331392:12345-192.168.206.51@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787574457.698039:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787574457.698244:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272331264 00000100:00100000:3.0:1787574457.698255:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272331264 00000100:00100000:0.0:1787574457.699691:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30990db0-f016-4bad-afb0-413c8b48dde7+6:13859:x1874407272331392:12345-192.168.206.51@tcp:33:mount.lustre.0 Request processed in 2048us (5974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574457.699708:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:2.0:1787574457.702437:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:2.0:1787574457.702453:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1874407272331264:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787574457.702498:0:15006:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 30990db0-f016-4bad-afb0-413c8b48dde7@192.168.206.51@tcp t0 exp 0000000000000000 cur 433 last 0 00000020:00000080:2.0:1787574457.702538:0:15006:0:(genops.c:1385:class_connect()) connect: client 30990db0-f016-4bad-afb0-413c8b48dde7, cookie 0xfe91058e646c0b95 00002000:00100000:2.0:1787574457.702569:0:15006:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 30990db0-f016-4bad-afb0-413c8b48dde7/ffff9829046fb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787574457.702582:0:15006:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787574457.702887:0:15006:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787574457.702930:0:15006:0:(import.c:65:import_set_state_nolock()) ffff982a4192b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574457.703274:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30990db0-f016-4bad-afb0-413c8b48dde7+6:2349:x1874407272331264:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 819us (8159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574457.703284:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:2.0:1787574457.922042:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574457.922525:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272331520 00000100:00100000:1.0:1787574457.922539:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272331520 00000100:00100000:1.0:1787574457.922673:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:1.0:1787574457.922687:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30990db0-f016-4bad-afb0-413c8b48dde7+6:13894:x1874407272331520:12345-192.168.206.51@tcp:101:mkdir.0 00010000:00010000:1.0:1787574457.922712:0:15671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574457.922741:0:15671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646c0b9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1efa6 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574457.922822:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0ba3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574457.922838:0:15671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574457.922857:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574457.923115:0:15671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787574457.923119:0:15671:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787574457.923250:0:15671:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574457.923286:0:15671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0a00/0xfe91058e646c0b9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efa6 expref: 8 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574457.923304:0:15671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efa6 expref: 7 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574457.923322:0:15671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34500) 00010000:00010000:1.0:1787574457.923325:0:15671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787574457.923329:0:15671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0c00, rc 0) 00000100:00100000:1.0:1787574457.923420:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30990db0-f016-4bad-afb0-413c8b48dde7+7:13894:x1874407272331520:12345-192.168.206.51@tcp:101:mkdir.0 Request processed in 735us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574457.923428:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00010000:00010000:0.0:1787574458.545392:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574459.569583:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574460.017641:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290145920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574460.017734:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574460.017856:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290145920 00000100:00100000:1.0:1787574460.017867:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290145920 00000100:00080000:0.0:1787574460.017945:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787574460.017950:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787574460.017965:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290145920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574460.018010:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787574460.018062:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290145920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574460.018070:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787574460.018148:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290145920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574460.019620:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290146048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574460.019692:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574460.019755:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290146048 00000100:00100000:0.0:1787574460.019762:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290146048 00000100:00100000:0.0:1787574460.019818:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787574460.019828:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290146048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574460.019867:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574460.022193:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290146048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2334us (2468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574460.022212:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787574460.022264:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574460.023504:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290146048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574460.030661:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574460.030694:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2841886-4ae8-43da-bc7c-46b9b13f805e:3301:1874407290146176:0@lo:400:kworker.0 00000100:00100000:2.0:1787574460.030789:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574460.030880:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874407290146304:0@lo:400:kworker.0 00000100:00100000:2.0:1787574460.030931:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574460.030971:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290146304 00000100:00100000:2.0:1787574460.030980:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290146304 00000100:00100000:2.0:1787574460.031050:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787574460.031060:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874407290146304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574460.031124:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874407290146304:12345-0@lo:400:kworker.0 Request processed in 64us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574460.031131:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787574460.031203:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874407290146304:0@lo:400:kworker.0 00000100:00100000:2.0:1787574460.031252:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290146432:0@lo:400:kworker.0 00000100:00100000:2.0:1787574460.031279:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574460.031322:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574460.031328:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290146560:0@lo:400:kworker.0 00000100:00100000:2.0:1787574460.031374:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574460.031411:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290146432 00000100:00100000:2.0:1787574460.031415:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290146432 00000100:00100000:2.0:1787574460.031455:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290146560 00000100:00100000:2.0:1787574460.031458:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290146560 00000100:00100000:2.0:1787574460.031479:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787574460.031486:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290146432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574460.031521:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290146432:12345-0@lo:400:kworker.0 Request processed in 36us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574460.031528:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787574460.031542:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787574460.031548:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290146560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574460.031575:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290146560:12345-0@lo:400:kworker.0 Request processed in 28us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574460.031582:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787574460.031611:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290146560:0@lo:400:kworker.0 00000100:00100000:2.0:1787574460.031620:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290146432:0@lo:400:kworker.0 00000100:00100000:3.0:1787574460.032846:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290146176 00000100:00100000:3.0:1787574460.032861:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290146176 00000100:00100000:3.0:1787574460.032923:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787574460.032933:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:3301:x1874407290146176:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787574460.032998:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574460.033023:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:3301:x1874407290146176:12345-0@lo:400:kworker.0 Request processed in 92us (2234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574460.033031:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787574460.033086:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2841886-4ae8-43da-bc7c-46b9b13f805e:3301:1874407290146176:0@lo:400:kworker.0 00000001:02000400:1.0:1787574460.578988:0:16294:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1787574460.580651:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cb815d5e-9f9e-47fd-838c-222c53157044 00000001:00100000:0.0:1787574460.580670:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 30990db0-f016-4bad-afb0-413c8b48dde7 00010000:00010000:1.0:1787574460.594930:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787574461.077512:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 30990db0-f016-4bad-afb0-413c8b48dde7 00010000:00010000:0.0:1787574461.621031:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787574462.634837:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 30990db0-f016-4bad-afb0-413c8b48dde7 00010000:00010000:3.0:1787574462.641435:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574462.746577:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574462.746627:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574462.746660:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574462.746693:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574462.746713:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574462.746733:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574462.746760:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574462.746802:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272332032 00000100:00100000:0.0:1787574462.746814:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272332032 00000100:00100000:1.0:1787574462.747306:0:15905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272332288 00000100:00100000:1.0:1787574462.747314:0:15905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272332288 00000100:00100000:1.0:1787574462.747359:0:15905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272331904 00000100:00100000:1.0:1787574462.747362:0:15905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272331904 00000100:00100000:1.0:1787574462.747391:0:15905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272332416 00000100:00100000:1.0:1787574462.747414:0:15905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272332416 00000100:00100000:1.0:1787574462.747442:0:15905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1787574462.747455:0:15905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30990db0-f016-4bad-afb0-413c8b48dde7+5:2351:x1874407272332288:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574462.747543:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272331776 00000100:00100000:2.0:1787574462.747549:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272331776 00000100:00100000:1.0:1787574462.747554:0:15905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30990db0-f016-4bad-afb0-413c8b48dde7+5:2351:x1874407272332288:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 100us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574462.747565:0:15905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1787574462.747587:0:15905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1787574462.747591:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272332160 00000100:00100000:2.0:1787574462.747597:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272332160 00000100:00100000:1.0:1787574462.747597:0:15905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cb815d5e-9f9e-47fd-838c-222c53157044+5:2351:x1874407272331904:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574462.747630:0:15905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cb815d5e-9f9e-47fd-838c-222c53157044+5:2351:x1874407272331904:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 35us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574462.747634:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:1.0:1787574462.747643:0:15905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1787574462.747649:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb815d5e-9f9e-47fd-838c-222c53157044+6:2351:x1874407272331776:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1787574462.747660:0:15905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:1.0:1787574462.747669:0:15905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30990db0-f016-4bad-afb0-413c8b48dde7+5:2351:x1874407272332416:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574462.747692:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb815d5e-9f9e-47fd-838c-222c53157044+6:2351:x1874407272331776:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 47us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574462.747700:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:1.0:1787574462.747704:0:15905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30990db0-f016-4bad-afb0-413c8b48dde7+5:2351:x1874407272332416:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 35us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574462.747715:0:15905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:2.0:1787574462.747730:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:2.0:1787574462.747739:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30990db0-f016-4bad-afb0-413c8b48dde7+6:2351:x1874407272332160:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574462.747771:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30990db0-f016-4bad-afb0-413c8b48dde7+6:2351:x1874407272332160:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 32us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574462.747778:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:2.0:1787574462.747845:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272331648 00000100:00100000:2.0:1787574462.747850:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272331648 00000100:00100000:0.0:1787574462.747986:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:0.0:1787574462.747997:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb815d5e-9f9e-47fd-838c-222c53157044+5:2351:x1874407272332032:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574462.748029:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb815d5e-9f9e-47fd-838c-222c53157044+5:2351:x1874407272332032:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 36us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574462.748035:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00080000:0.0:1787574462.748778:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787574462.748785:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574462.748788:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574462.749138:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:2.0:1787574462.749148:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+13:2351:x1874407272331648:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574462.749217:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+13:2351:x1874407272331648:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 70us (2522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574462.749224:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 103 00000020:00000080:1.0:1787574463.409124:0:16443:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff2c74d660 20000000:00000080:1.0:1787574463.409148:0:16443:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff982908087400 uarg=0000000000000000 20000000:01000000:1.0:1787574463.409551:0:16443:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787574463.409559:0:16443:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787574463.409565:0:16443:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787574463.414897:0:16444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1787574463.415211:0:16443:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787574463.425414:0:16443:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787574463.425648:0:16443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982a069fa800/0xfe91058e646c0baa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.425678:0:16443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a069fa000/0xfe91058e646c08a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c089a expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.425687:0:16443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a057e0e00/0xfe91058e646c08ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c08e7 expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.425693:0:16443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a057e1c00/0xfe91058e646c095e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c0957 expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.425703:0:16443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a057e1a00/0xfe91058e646c0b48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef1a expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.425710:0:16443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982a069fb200/0xfe91058e646c0b80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef7c expref: 12 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.425732:0:16443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982a069fa800/0xfe91058e646c0baa lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.425789:0:16443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a069fb200/0xfe91058e646c0b80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef7c expref: 12 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.425807:0:16443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982a069fb200/0xfe91058e646c0b80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef7c expref: 12 pid: 14319 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574463.425825:0:16443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16443:1874407290146688:192.168.206.51@tcp:104: 00010000:00010000:2.0:1787574463.426019:0:16443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a057e1a00/0xfe91058e646c0b48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef1a expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.426029:0:16443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982a057e1a00/0xfe91058e646c0b48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef1a expref: 12 pid: 14318 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574463.426038:0:16443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16443:1874407290146816:192.168.206.51@tcp:104: 00010000:00010000:2.0:1787574463.426072:0:16443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a057e1c00/0xfe91058e646c095e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646c0957 expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.426080:0:16443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982a057e1c00/0xfe91058e646c095e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646c0957 expref: 18 pid: 14316 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574463.426090:0:16443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a40fe2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16443:1874407290146944:0@lo:104: 00000100:00100000:2.0:1787574463.426135:0:16443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574463.426203:0:16443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a057e0e00/0xfe91058e646c08ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646c08e7 expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.426222:0:16443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982a057e0e00/0xfe91058e646c08ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646c08e7 expref: 18 pid: 14318 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574463.426231:0:16443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16443:1874407290147072:0@lo:104: 00000100:00100000:2.0:1787574463.426253:0:16443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574463.426275:0:16443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982a069fa000/0xfe91058e646c08a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfe91058e646c089a expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.426282:0:16443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982a069fa000/0xfe91058e646c08a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfe91058e646c089a expref: 18 pid: 14318 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574463.426290:0:16443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16443:1874407290147200:0@lo:104: 00000100:00100000:2.0:1787574463.426313:0:16443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574463.426323:0:16443:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a05009540 going to sleep for 11 seconds 00000100:00100000:1.0:1787574463.426639:0:14308:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787574463.426657:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290146944 00000100:00100000:1.0:1787574463.426665:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290146944 00000100:00100000:1.0:1787574463.426712:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290147072 00000100:00100000:1.0:1787574463.426722:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290147072 00000100:00100000:1.0:1787574463.426737:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290147200 00000100:00100000:1.0:1787574463.426739:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290147200 00000100:00100000:1.0:1787574463.426753:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787574463.426763:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a40fe3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b2841886-4ae8-43da-bc7c-46b9b13f805e+5:16443:x1874407290146944:12345-0@lo:104: 00010000:00010000:1.0:1787574463.426778:0:14308:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a027f3600/0xfe91058e646c0957 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646c095e expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574463.426859:0:14308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787574463.426866:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a40fe3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b2841886-4ae8-43da-bc7c-46b9b13f805e+5:16443:x1874407290146944:12345-0@lo:104: Request processed in 105us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574463.426933:0:16443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16443:1874407290146944:0@lo:104: 00000100:00100000:1.0:1787574463.426953:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787574463.426974:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787574463.426981:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b2841886-4ae8-43da-bc7c-46b9b13f805e+4:16443:x1874407290147072:12345-0@lo:104: 00010000:00010000:1.0:1787574463.426989:0:14308:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c08e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646c08ee expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574463.427136:0:16443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16443:1874407290147072:0@lo:104: 00010000:00010000:1.0:1787574463.427145:0:14308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787574463.427151:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b2841886-4ae8-43da-bc7c-46b9b13f805e+4:16443:x1874407290147072:12345-0@lo:104: Request processed in 171us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574463.427158:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787574463.427194:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787574463.427201:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b2841886-4ae8-43da-bc7c-46b9b13f805e+3:16443:x1874407290147200:12345-0@lo:104: 00010000:00010000:1.0:1787574463.427211:0:14308:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff982a16142600/0xfe91058e646c089a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646c08a1 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574463.427523:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574463.427532:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a027f3600/0xfe91058e646c0957 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646c095e expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574463.427540:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a027f3600 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:0.0:1787574463.427554:0:14313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a027f3600/0xfe91058e646c0957 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646c095e expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574463.427574:0:14313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a027f3600/0xfe91058e646c0957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646c095e expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574463.427582:0:14313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a027f3600/0xfe91058e646c0957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646c095e expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574463.427589:0:14313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787574463.427633:0:14313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a027f3600/0xfe91058e646c0957 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646c095e expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574463.427640:0:14313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574463.427665:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a027f3600/0xfe91058e646c0957 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646c095e expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574463.427742:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11bb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2841886-4ae8-43da-bc7c-46b9b13f805e:3300:1874407290147328:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787574463.427785:0:14308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787574463.427791:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574463.427796:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b2841886-4ae8-43da-bc7c-46b9b13f805e+3:16443:x1874407290147200:12345-0@lo:104: Request processed in 593us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574463.427813:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787574463.427847:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787574463.427853:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c08e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646c08ee expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574463.428040:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a027f3600/0xfe91058e646c0957 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646c095e expref: -99 pid: 15726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574463.428043:0:16443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16443:1874407290147200:0@lo:104: 00010000:00010000:0.0:1787574463.428058:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574463.428061:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff982a16142600/0xfe91058e646c089a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfe91058e646c08a1 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574463.428068:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a16142600 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:0.0:1787574463.428071:0:14313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a16142600/0xfe91058e646c089a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646c08a1 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574463.428078:0:14313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a16142600/0xfe91058e646c089a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646c08a1 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574463.428085:0:14313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a16142600/0xfe91058e646c089a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646c08a1 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574463.428097:0:14313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787574463.428113:0:14313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a16142600/0xfe91058e646c089a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646c08a1 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574463.428120:0:14313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574463.428134:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a16142600/0xfe91058e646c089a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646c08a1 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574463.428141:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a16142600/0xfe91058e646c089a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646c08a1 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574463.428152:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574463.428154:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574463.428156:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574463.428252:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11bb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2841886-4ae8-43da-bc7c-46b9b13f805e:3301:1874407290147456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574463.428283:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787574463.428410:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574463.428464:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290147328 00000100:00100000:0.0:1787574463.428472:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290147328 00010000:00010000:0.0:1787574463.428499:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a057e1c00/0xfe91058e646c095e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646c0957 expref: 19 pid: 14316 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574463.428529:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290147456 00000100:00100000:0.0:1787574463.428532:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290147456 00000100:00100000:2.0:1787574463.428585:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787574463.428596:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2841886-4ae8-43da-bc7c-46b9b13f805e+20:3300:x1874407290147328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787574463.428605:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a069fa000/0xfe91058e646c08a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646c089a expref: 20 pid: 14318 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.428609:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574463.428615:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a057e1c00/0xfe91058e646c095e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646c0957 expref: 20 pid: 14316 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574463.428621:0:14310:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1787574463.428625:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a057e1c00/0xfe91058e646c095e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646c0957 expref: 20 pid: 14316 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574463.428628:0:14310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1787574463.428647:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a057e1c00/0xfe91058e646c095e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646c0957 expref: 20 pid: 14316 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.428661:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574463.428692:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:3300:x1874407290147328:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574463.428699:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787574463.428715:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787574463.428722:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2841886-4ae8-43da-bc7c-46b9b13f805e+18:3301:x1874407290147456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574463.428729:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574463.428734:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a069fa000/0xfe91058e646c08a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646c089a expref: 18 pid: 14318 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.428742:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a069fa000/0xfe91058e646c08a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646c089a expref: 18 pid: 14318 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.428752:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a069fa000/0xfe91058e646c08a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646c089a expref: 18 pid: 14318 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.428761:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574463.428793:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2841886-4ae8-43da-bc7c-46b9b13f805e+17:3301:x1874407290147456:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574463.428799:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787574463.428904:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11bb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2841886-4ae8-43da-bc7c-46b9b13f805e:3301:1874407290147456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574463.430427:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11bb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2841886-4ae8-43da-bc7c-46b9b13f805e:3300:1874407290147328:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787574463.432466:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fb800 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1787574463.432475:0:14312:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c08e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfe91058e646c08ee expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574463.432505:0:14312:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c08e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfe91058e646c08ee expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574463.432513:0:14312:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c08e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfe91058e646c08ee expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574463.432519:0:14312:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787574463.432837:0:14312:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c08e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646c08ee expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.432847:0:14312:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787574463.432887:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c08e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646c08ee expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.432904:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff982a069fb800/0xfe91058e646c08e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfe91058e646c08ee expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.432931:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574463.432934:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574463.432937:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574463.433254:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787574463.433283:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2841886-4ae8-43da-bc7c-46b9b13f805e:3299:1874407290147584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574463.433388:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574463.433455:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290147584 00000100:00100000:2.0:1787574463.433465:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290147584 00010000:00010000:2.0:1787574463.433506:0:14309:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a057e0e00/0xfe91058e646c08ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646c08e7 expref: 17 pid: 14318 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574463.433550:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787574463.433561:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982904ee9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2841886-4ae8-43da-bc7c-46b9b13f805e+17:3299:x1874407290147584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574463.433578:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574463.433584:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a057e0e00/0xfe91058e646c08ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfe91058e646c08e7 expref: 17 pid: 14318 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.433596:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a057e0e00/0xfe91058e646c08ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfe91058e646c08e7 expref: 17 pid: 14318 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.433614:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a057e0e00/0xfe91058e646c08ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfe91058e646c08e7 expref: 17 pid: 14318 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.433632:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574463.433687:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982904ee9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:3299:x1874407290147584:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574463.433694:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787574463.433857:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2841886-4ae8-43da-bc7c-46b9b13f805e:3299:1874407290147584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574463.434601:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574463.434713:0:16445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272332544 00000100:00100000:1.0:1787574463.434720:0:16445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272332544 00010000:00010000:1.0:1787574463.434752:0:16445:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a057e1a00/0xfe91058e646c0b48 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef1a expref: 13 pid: 14318 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574463.434793:0:16445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:1.0:1787574463.434803:0:16445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dac4a08-d60d-45ca-bc3d-721804b2f529+13:2353:x1874407272332544:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574463.434815:0:16445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574463.434820:0:16445:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a057e1a00/0xfe91058e646c0b48 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef1a expref: 13 pid: 14318 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574463.434830:0:16445:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a057e1a00/0xfe91058e646c0b48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef1a expref: 13 pid: 14318 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574463.434847:0:16445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574463.434902:0:16445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dac4a08-d60d-45ca-bc3d-721804b2f529+13:2353:x1874407272332544:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 101us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574463.434910:0:16445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:2.0:1787574463.435264:0:16443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16443:1874407290146688:192.168.206.51@tcp:104: 00010000:00010000:2.0:1787574463.435297:0:16443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a057e1a00/0xfe91058e646c0b48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef1a expref: 12 pid: 14318 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574463.435311:0:16443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a40fe1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16443:1874407290146816:192.168.206.51@tcp:104: 00010000:00010000:2.0:1787574463.435346:0:16443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982a069fa800/0xfe91058e646c0baa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574463.435899:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574463.436068:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272332672 00000100:00100000:2.0:1787574463.436076:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272332672 00010000:00010000:2.0:1787574463.436528:0:14309:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982a069fb200/0xfe91058e646c0b80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef7c expref: 12 pid: 14319 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574463.436607:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:2.0:1787574463.436619:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dac4a08-d60d-45ca-bc3d-721804b2f529+12:2350:x1874407272332672:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574463.436633:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574463.436641:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982a069fb200/0xfe91058e646c0b80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef7c expref: 12 pid: 14319 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.436653:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982a069fb200/0xfe91058e646c0b80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef7c expref: 12 pid: 14319 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.436671:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a069fb200/0xfe91058e646c0b80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef7c expref: 12 pid: 14319 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.436687:0:14309:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982a069fa800/0xfe91058e646c0baa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.436697:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a069fa800/0xfe91058e646c0baa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.436727:0:14309:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a069fa800/0xfe91058e646c0baa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.436735:0:14309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982a069fa800/0xfe91058e646c0baa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.436742:0:14309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982a069fa800/0xfe91058e646c0baa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.436750:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982a069fa800/0xfe91058e646c0baa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.436756:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fa800 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574463.436762:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982a069fa800/0xfe91058e646c0baa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.436771:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982a069fa800/0xfe91058e646c0baa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.436788:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982a069fa800/0xfe91058e646c0baa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574463.436798:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574463.436869:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dac4a08-d60d-45ca-bc3d-721804b2f529+11:2350:x1874407272332672:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 253us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574463.436877:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00010000:00010000:3.0:1787574463.436956:0:16443:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982a069fa800/0xfe91058e646c0baa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574463.436964:0:16443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982a069fa800/0xfe91058e646c0baa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574463.436971:0:16443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982a069fa800/0xfe91058e646c0baa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574463.665609:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574464.690947:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787574464.755061:0:14321:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787574464.755072:0:14321:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982a2e03e000 from 10 10000000:01000000:1.0:1787574464.755079:0:14321:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787574464.755139:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a057e0400/0xfe91058e646c0bb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574464.755201:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a057e0400/0xfe91058e646c0bb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574464.755216:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a057e0400/0xfe91058e646c0bb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574464.755246:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290147712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787574464.755347:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574464.755422:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff982906a61780 going to sleep for 11 seconds 00000100:00100000:3.0:1787574464.755566:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290147712 00000100:00100000:3.0:1787574464.755577:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290147712 00000100:00100000:3.0:1787574464.755646:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787574464.755658:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+16:14321:x1874407290147712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574464.755673:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574464.755690:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a027f2c00/0xfe91058e646c0bb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646c0bb1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574464.755717:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a027f2c00/0xfe91058e646c0bb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646c0bb1 expref: 17 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574464.755728:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a027f2c00/0xfe91058e646c0bb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c0bb1 expref: 17 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574464.755746:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a027f2c00, rc 0) 00000100:00100000:3.0:1787574464.755802:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+17:14321:x1874407290147712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574464.755809:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787574464.757725:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290147712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574464.757760:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a057e0400/0xfe91058e646c0bb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0bb8 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574464.757775:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a057e0400/0xfe91058e646c0bb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646c0bb8 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574464.757887:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290147840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574464.757966:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574464.758016:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff982906a61780 going to sleep for 11 seconds 00000100:00100000:2.0:1787574464.758189:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290147840 00000100:00100000:2.0:1787574464.758197:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290147840 00000100:00100000:2.0:1787574464.758247:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787574464.758275:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06997850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+17:14321:x1874407290147840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574464.758833:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06997850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+17:14321:x1874407290147840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 559us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574464.758842:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787574464.758937:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290147840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574464.758982:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290147968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574464.759031:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574464.759075:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a11445600 going to sleep for 11 seconds 00000100:00100000:0.0:1787574464.762737:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290147968 00000100:00100000:0.0:1787574464.762758:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290147968 00000100:00100000:0.0:1787574464.762838:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787574464.762850:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+17:14321:x1874407290147968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574464.763219:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+17:14321:x1874407290147968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 370us (4186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574464.763228:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787574464.763310:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290147968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787574464.764599:0:16512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787574464.765009:0:14321:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787574464.765049:0:14321:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787574464.765063:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a057e0400/0xfe91058e646c0bb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0bb8 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574464.765077:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a057e0400/0xfe91058e646c0bb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0bb8 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574464.765111:0:14321:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787574464.765114:0:14321:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982a03510800 from 10 10000000:01000000:1.0:1787574464.765117:0:14321:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787574464.765212:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a057e0a00/0xfe91058e646c0bbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574464.765221:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a057e0a00/0xfe91058e646c0bbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574464.765232:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a057e0a00/0xfe91058e646c0bbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574464.765262:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290148096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787574464.765787:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574464.765836:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff982906a61000 going to sleep for 11 seconds 00000100:00100000:0.0:1787574464.766195:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290148096 00000100:00100000:0.0:1787574464.766206:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290148096 00000100:00100000:0.0:1787574464.766266:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787574464.766277:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+17:14321:x1874407290148096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574464.766294:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574464.766313:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a048f6000/0xfe91058e646c0bc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646c0bbf expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574464.766654:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a048f6000/0xfe91058e646c0bc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646c0bbf expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574464.766668:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a048f6000/0xfe91058e646c0bc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c0bbf expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574464.766679:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a048f6000, rc 0) 00000100:00100000:1.0:1787574464.766754:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+18:14321:x1874407290148096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 479us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574464.766763:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787574464.767108:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290148096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574464.767129:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a057e0a00/0xfe91058e646c0bbf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0bc6 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574464.767139:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a057e0a00/0xfe91058e646c0bbf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646c0bc6 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574464.767415:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11bb4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290148224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574464.767480:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574464.767558:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04fb1240 going to sleep for 11 seconds 00000100:00100000:2.0:1787574464.773088:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290148224 00000100:00100000:2.0:1787574464.773113:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290148224 00000100:00100000:3.0:1787574464.773425:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787574464.773440:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06995450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+18:14321:x1874407290148224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574464.773851:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06995450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+18:14321:x1874407290148224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 413us (6369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574464.773860:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787574464.774047:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11bb4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290148224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574464.774115:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11bb4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290148352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574464.774204:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574464.774241:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04fb1240 going to sleep for 11 seconds 00000100:00100000:2.0:1787574464.774477:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290148352 00000100:00100000:2.0:1787574464.774484:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290148352 00000100:00100000:2.0:1787574464.774528:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787574464.774547:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+18:14321:x1874407290148352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574464.774735:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+18:14321:x1874407290148352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574464.774743:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787574464.774831:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11bb4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290148352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787574464.776695:0:16513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787574464.776940:0:14321:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787574464.776968:0:14321:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787574464.776982:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a057e0a00/0xfe91058e646c0bbf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0bc6 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574464.776995:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a057e0a00/0xfe91058e646c0bbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0bc6 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574464.777009:0:14321:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787574464.777011:0:14321:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982905b62800 from 10 10000000:01000000:2.0:1787574464.777015:0:14321:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787574464.777069:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a069fbe00/0xfe91058e646c0bcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574464.777078:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff982a069fbe00/0xfe91058e646c0bcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574464.777110:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff982a069fbe00/0xfe91058e646c0bcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574464.777139:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290148480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787574464.777248:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574464.777294:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a05664600 going to sleep for 11 seconds 00000100:00100000:3.0:1787574464.777509:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290148480 00000100:00100000:3.0:1787574464.777517:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290148480 00000100:00100000:3.0:1787574464.777572:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787574464.777583:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+18:14321:x1874407290148480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574464.777598:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574464.777615:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a027f2000/0xfe91058e646c0bd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfe91058e646c0bcd expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574464.777642:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a027f2000/0xfe91058e646c0bd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfe91058e646c0bcd expref: 19 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574464.777653:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a027f2000/0xfe91058e646c0bd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfe91058e646c0bcd expref: 19 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574464.777670:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a027f2000, rc 0) 00000100:00100000:3.0:1787574464.777725:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:14321:x1874407290148480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574464.777732:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787574464.777999:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290148480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574464.778016:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff982a069fbe00/0xfe91058e646c0bcd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0bd4 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574464.778026:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff982a069fbe00/0xfe91058e646c0bcd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfe91058e646c0bd4 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574464.778157:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290148608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574464.778221:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574464.778253:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a05664600 going to sleep for 11 seconds 00000100:00100000:3.0:1787574464.778956:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290148608 00000100:00100000:3.0:1787574464.778965:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290148608 00000100:00100000:3.0:1787574464.779066:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787574464.779076:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06994850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:14321:x1874407290148608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574464.779467:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06994850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:14321:x1874407290148608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 391us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574464.779475:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787574464.779562:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290148608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574464.779607:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290148736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574464.779652:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574464.783377:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a05664600 going to sleep for 11 seconds 00000100:00100000:1.0:1787574464.788113:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290148736 00000100:00100000:1.0:1787574464.788136:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290148736 00000100:00100000:1.0:1787574464.788226:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787574464.788238:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:14321:x1874407290148736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574464.788615:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:14321:x1874407290148736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 377us (8960us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574464.788625:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787574464.794995:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2841886-4ae8-43da-bc7c-46b9b13f805e:14321:1874407290148736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787574464.798824:0:16514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787574464.799200:0:14321:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787574464.799229:0:14321:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787574464.799245:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff982a069fbe00/0xfe91058e646c0bcd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0bd4 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574464.799258:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff982a069fbe00/0xfe91058e646c0bcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfe91058e646c0bd4 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574465.137744:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574465.137778:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290148864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574465.137879:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574465.137983:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290148864 00000100:00100000:3.0:1787574465.137994:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290148864 00000100:00100000:3.0:1787574465.138063:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787574465.138075:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290148864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787574465.138126:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787574465.138206:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290148864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574465.138215:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787574465.138267:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290148864:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787574465.138808:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787574465.139960:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290148992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574465.140044:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574465.140132:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290148992 00000100:00100000:0.0:1787574465.140141:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290148992 00000100:00100000:0.0:1787574465.140225:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787574465.140236:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290148992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574465.140279:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787574465.140330:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874407290148992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574465.140337:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787574465.140807:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574465.140861:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874407290148992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574465.142277:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874407290149504:0@lo:400:kworker.0 00000100:00100000:3.0:1787574465.142755:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574465.142816:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574465.142823:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2841886-4ae8-43da-bc7c-46b9b13f805e:3300:1874407290149120:0@lo:400:kworker.0 00000100:00100000:3.0:1787574465.142857:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574465.142903:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290149120 00000100:00100000:3.0:1787574465.142912:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290149120 00000100:00100000:3.0:1787574465.142958:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787574465.142968:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06995850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:3300:x1874407290149120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574465.143273:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290149504 00000100:00100000:1.0:1787574465.143278:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290149504 00000100:00100000:1.0:1787574465.143324:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787574465.143332:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874407290149504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574465.143427:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874407290149504:12345-0@lo:400:kworker.0 Request processed in 95us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574465.143435:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787574465.143865:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874407290149376:0@lo:400:kworker.0 00000100:00100000:0.0:1787574465.143907:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574465.143942:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787574465.143948:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a8a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290149248:0@lo:400:kworker.0 00000100:00100000:0.0:1787574465.144007:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574465.144050:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290149376 00000100:00100000:0.0:1787574465.144055:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290149376 00000100:00100000:0.0:1787574465.144089:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290149248 00000100:00100000:0.0:1787574465.144092:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290149248 00000100:00100000:0.0:1787574465.144109:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787574465.144117:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874407290149376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574465.144158:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874407290149376:12345-0@lo:400:kworker.0 Request processed in 42us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574465.144190:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787574465.144205:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787574465.144211:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290149248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574465.144239:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874407290149248:12345-0@lo:400:kworker.0 Request processed in 28us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574465.144246:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1787574465.144268:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574465.144301:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874407290149248:0@lo:400:kworker.0 00000100:00100000:0.0:1787574465.144313:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874407290149376:0@lo:400:kworker.0 00000100:00100000:3.0:1787574465.146024:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06995850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:3300:x1874407290149120:12345-0@lo:400:kworker.0 Request processed in 3028us (3136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574465.146040:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787574465.146291:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2841886-4ae8-43da-bc7c-46b9b13f805e:3300:1874407290149120:0@lo:400:kworker.0 00000100:00100000:3.0:1787574465.146309:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a8a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874407290149504:0@lo:400:kworker.0 00000100:00100000:2.0:1787574465.438437:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574465.438602:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272332800 00000100:00100000:1.0:1787574465.438620:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272332800 00000100:00100000:1.0:1787574465.438696:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:1.0:1787574465.438710:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+11:13748:x1874407272332800:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574465.438733:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574465.438758:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a057e0e00/0xfe91058e646c0bdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1efad expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574465.438795:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a057e0e00/0xfe91058e646c0bdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efad expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574465.438816:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a057e0e00/0xfe91058e646c0bdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efad expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574465.438830:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e0e00, rc 0) 00000100:00100000:1.0:1787574465.438906:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+12:13748:x1874407272332800:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 199us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574465.438914:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:0.0:1787574465.444828:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574465.447543:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272332928 00000100:00100000:1.0:1787574465.447564:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272332928 00000100:00100000:0.0:1787574465.450177:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:0.0:1787574465.450193:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06994450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dac4a08-d60d-45ca-bc3d-721804b2f529+12:13748:x1874407272332928:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574465.450891:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06994450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dac4a08-d60d-45ca-bc3d-721804b2f529+12:13748:x1874407272332928:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 696us (6073us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574465.450902:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:0.0:1787574465.475927:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574465.476128:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272333056 00000100:00100000:3.0:1787574465.476141:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272333056 00000100:00100000:3.0:1787574465.476237:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:3.0:1787574465.476248:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06994050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+12:13748:x1874407272333056:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574465.476690:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06994050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+12:13748:x1874407272333056:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 441us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574465.476700:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:0.0:1787574465.479850:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574465.479934:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272333184 00000100:00100000:3.0:1787574465.479947:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272333184 00000100:00100000:3.0:1787574465.480017:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:3.0:1787574465.480030:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a06995c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dac4a08-d60d-45ca-bc3d-721804b2f529+12:13748:x1874407272333184:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574465.480065:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574465.480089:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982a027f3400/0xfe91058e646c0be2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1efb4 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574465.480124:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982a027f3400/0xfe91058e646c0be2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efb4 expref: 13 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574465.480137:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982a027f3400/0xfe91058e646c0be2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efb4 expref: 13 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574465.480149:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a027f3400, rc 0) 00000100:00100000:3.0:1787574465.480253:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a06995c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dac4a08-d60d-45ca-bc3d-721804b2f529+13:13748:x1874407272333184:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 224us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574465.480261:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:0.0:1787574465.490688:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574465.492413:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272333312 00000100:00100000:3.0:1787574465.492432:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272333312 00000100:00100000:3.0:1787574465.492736:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:3.0:1787574465.492749:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+13:13748:x1874407272333312:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574465.493306:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+13:13748:x1874407272333312:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 555us (2631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574465.493318:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:0.0:1787574465.498649:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574465.499609:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272333440 00000100:00100000:1.0:1787574465.499625:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272333440 00000100:00100000:1.0:1787574465.499740:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:1.0:1787574465.499753:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+13:13748:x1874407272333440:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574465.500042:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dac4a08-d60d-45ca-bc3d-721804b2f529+13:13748:x1874407272333440:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 290us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574465.500051:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 119 00010000:00010000:2.0:1787574465.713767:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787574466.098028:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787574466.675093:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574466.679220:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272333568 00000100:00100000:0.0:1787574466.679242:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272333568 00000100:00100000:0.0:1787574466.679523:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:0.0:1787574466.679541:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb815d5e-9f9e-47fd-838c-222c53157044+6:14406:x1874407272333568:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574466.679569:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574466.679601:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7a00/0xfe91058e646c0be9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1efbb expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.679687:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0bf0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.679704:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0bf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.679978:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0bf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.679999:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0bf7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.680007:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.680013:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.684517:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7c00/0xfe91058e646c0bfe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.684561:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7c00/0xfe91058e646c0bfe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.684576:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7c00/0xfe91058e646c0bfe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574466.684692:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787574466.684697:0:14325:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787574466.684804:0:14325:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7c00/0xfe91058e646c0bfe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.684818:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0bf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.684825:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0bf0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.684832:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0bf0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.684839:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a048f7600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574466.684844:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0bf0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.684853:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0bf0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.684867:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34500) 00010000:00010000:0.0:1787574466.684870:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574466.684875:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0bf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.684891:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0bf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.684905:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.684911:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0bf7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.684917:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.684923:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a048f6c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574466.684926:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.684932:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0bf7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.684939:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff982a0296bd00) 00010000:00010000:0.0:1787574466.684942:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574466.684944:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0bf7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.684950:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0bf7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.684997:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7a00/0xfe91058e646c0be9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efbb expref: 8 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.685023:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7c00/0xfe91058e646c0bfe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efbb expref: 7 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.685031:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff982a0296b200) 00010000:00010000:0.0:1787574466.685034:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787574466.685036:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a048f7c00, rc 0) 00000100:00100000:0.0:1787574466.685136:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb815d5e-9f9e-47fd-838c-222c53157044+7:14406:x1874407272333568:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 5600us (10057us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574466.685147:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00080000:2.0:1787574466.687587:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574466.690371:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574466.695458:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272333824 00000100:00100000:2.0:1787574466.695502:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272333824 00000100:00100000:3.0:1787574466.698635:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:3.0:1787574466.698656:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb815d5e-9f9e-47fd-838c-222c53157044+7:14406:x1874407272333824:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574466.698684:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574466.698730:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f3a00/0xfe91058e646c0c05 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1efc2 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.698833:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f3600/0xfe91058e646c0c0c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.698851:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f3600/0xfe91058e646c0c0c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.698867:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f3600/0xfe91058e646c0c0c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.698885:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2e00/0xfe91058e646c0c13 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.698893:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2e00/0xfe91058e646c0c13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.698901:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2e00/0xfe91058e646c0c13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.701925:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626800/0xfe91058e646c0c1a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.701968:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626800/0xfe91058e646c0c1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.701982:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626800/0xfe91058e646c0c1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574466.701998:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787574466.702326:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f3600/0xfe91058e646c0c0c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.702347:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f3600/0xfe91058e646c0c0c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.702364:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f3600/0xfe91058e646c0c0c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.702372:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a027f3600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574466.702377:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f3600/0xfe91058e646c0c0c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.703035:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f3600/0xfe91058e646c0c0c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.703055:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff982a0296b200) 00010000:00010000:3.0:1787574466.703058:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574466.703063:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f3600/0xfe91058e646c0c0c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.703069:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f3600/0xfe91058e646c0c0c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.703086:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2e00/0xfe91058e646c0c13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.703093:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2e00/0xfe91058e646c0c13 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.703099:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2e00/0xfe91058e646c0c13 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.703105:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a027f2e00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574466.703117:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2e00/0xfe91058e646c0c13 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.703123:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2e00/0xfe91058e646c0c13 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.703131:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff982a04dc0f00) 00010000:00010000:3.0:1787574466.703134:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574466.703137:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2e00/0xfe91058e646c0c13 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.703142:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f2e00/0xfe91058e646c0c13 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.703864:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a027f3a00/0xfe91058e646c0c05 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efc2 expref: 10 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.703886:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626800/0xfe91058e646c0c1a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efc2 expref: 9 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.703895:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982a04dc0b00) 00010000:00010000:3.0:1787574466.703897:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574466.703900:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a04626800, rc 0) 00000100:00100000:3.0:1787574466.703995:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb815d5e-9f9e-47fd-838c-222c53157044+9:14406:x1874407272333824:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 5343us (13712us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787574466.704006:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:3.0:1787574466.711626:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574466.712443:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272333952 00000100:00100000:0.0:1787574466.712459:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272333952 00000100:00100000:0.0:1787574466.712542:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:0.0:1787574466.712557:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb815d5e-9f9e-47fd-838c-222c53157044+9:14406:x1874407272333952:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787574466.712707:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb815d5e-9f9e-47fd-838c-222c53157044+9:14406:x1874407272333952:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 153us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574466.712716:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:2.0:1787574466.736455:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574466.736619:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272334080 00000100:00100000:1.0:1787574466.736633:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272334080 00000100:00100000:1.0:1787574466.736814:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:1.0:1787574466.736827:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb815d5e-9f9e-47fd-838c-222c53157044+9:14412:x1874407272334080:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1787574466.736853:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574466.736879:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1a00/0xfe91058e646c0c28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1efc9 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.736958:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0c2f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.736985:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0c2f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.736997:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0c2f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.737014:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0c36 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.737022:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.737029:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.737468:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574466.740016:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0c2f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.740038:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0c2f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.740047:0:14326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0c2f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.740055:0:14326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574466.740059:0:14326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0c2f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.740067:0:14326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0c2f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.740087:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34500) 00010000:00010000:1.0:1787574466.740098:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574466.740105:0:14326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0c2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.740112:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0c2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.740130:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.740136:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0c36 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.740143:0:14326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0c36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.740148:0:14326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574466.740151:0:14326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0c36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.740158:0:14326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0c36 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.740521:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff982a04da2f00) 00010000:00010000:1.0:1787574466.740526:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574466.740530:0:14326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0c36 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.740536:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0c36 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.740596:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1a00/0xfe91058e646c0c28 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efc9 expref: 10 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.740616:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34500) 00010000:00010000:1.0:1787574466.740619:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574466.740624:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1a00/0xfe91058e646c0c28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efc9 expref: 10 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.740634:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1a00, rc 0) 00000100:00100000:1.0:1787574466.740726:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb815d5e-9f9e-47fd-838c-222c53157044+9:14412:x1874407272334080:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 3899us (4284us total) trans 0 rc 301/301 00000100:00100000:1.0:1787574466.740737:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:0.0:1787574466.747985:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574466.748236:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272334208 00000100:00100000:1.0:1787574466.748252:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272334208 00000100:00100000:0.0:1787574466.748439:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:0.0:1787574466.748451:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cb815d5e-9f9e-47fd-838c-222c53157044+9:14412:x1874407272334208:12345-192.168.206.51@tcp:700:lfs.0 00000100:00100000:0.0:1787574466.748818:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cb815d5e-9f9e-47fd-838c-222c53157044+9:14412:x1874407272334208:12345-192.168.206.51@tcp:700:lfs.0 Request processed in 367us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574466.748827:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1787574466.755233:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574466.755598:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272334464 00000100:00100000:0.0:1787574466.755628:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272334464 00000100:00100000:0.0:1787574466.755705:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:0.0:1787574466.755718:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb815d5e-9f9e-47fd-838c-222c53157044+9:14412:x1874407272334464:12345-192.168.206.51@tcp:36:lfs.0 00010000:00010000:0.0:1787574466.755791:0:15671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574466.755825:0:15671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c0b6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1ef44 expref: 9 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.755852:0:15671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34500) 00010000:00010000:0.0:1787574466.755857:0:15671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574466.757285:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0c3d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.757321:0:15671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0ba3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efa6 expref: 5 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.757332:0:15671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0c3d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.757390:0:15671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efa6 expref: 5 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.757408:0:15671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0ba3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efa6 expref: 5 pid: 15671 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574466.757428:0:15671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a11bb4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15671:1874407290149632:192.168.206.51@tcp:104: 00000100:00100000:0.0:1787574466.757569:0:15671:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a04fb1240 going to sleep for 11 seconds 00000100:00100000:2.0:1787574466.762236:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574466.763349:0:16445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272334592 00000100:00100000:1.0:1787574466.763373:0:16445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272334592 00010000:00010000:1.0:1787574466.763457:0:16445:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0ba3 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efa6 expref: 6 pid: 15671 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574466.763501:0:16445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:1.0:1787574466.763512:0:16445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30990db0-f016-4bad-afb0-413c8b48dde7+6:2350:x1874407272334592:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574466.763529:0:16445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574466.763537:0:16445:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0ba3 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efa6 expref: 6 pid: 15671 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.763551:0:16445:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0ba3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efa6 expref: 6 pid: 15671 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.763576:0:16445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34500) 00010000:00010000:1.0:1787574466.763596:0:16445:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0c3d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.763608:0:16445:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0c3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.763616:0:16445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0c3d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.763637:0:16445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574466.763705:0:16445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30990db0-f016-4bad-afb0-413c8b48dde7+6:2350:x1874407272334592:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 194us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574466.763712:0:16445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00010000:00010000:0.0:1787574466.763936:0:15671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0ba3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efa6 expref: 5 pid: 15671 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574466.763968:0:15671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a11bb4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15671:1874407290149632:192.168.206.51@tcp:104: 00010000:00010000:0.0:1787574466.763996:0:15671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0c3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.764006:0:15671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0c3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.764012:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0c3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.764037:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0c44 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.764047:0:15671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0c44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.764055:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0c44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574466.765834:0:15671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787574466.765854:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0c3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.765865:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0c3d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.765873:0:15671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0c3d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.765887:0:15671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a048f6c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574466.765898:0:15671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0c3d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.765908:0:15671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0c3d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.765926:0:15671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34500) 00010000:00010000:0.0:1787574466.765929:0:15671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574466.765934:0:15671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0c3d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.765941:0:15671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0c3d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574466.765964:0:15671:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd3b9837 reply state 00000000e2d90f2a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0c44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574466.765974:0:15671:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574466.766095:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb815d5e-9f9e-47fd-838c-222c53157044+10:14412:x1874407272334464:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 10376us (10873us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787574466.766104:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00080000:2.0:1787574466.766431:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787574466.768402:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0c44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.768421:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0c44 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.768429:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0c44 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.768436:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a048f7600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574466.768441:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0c44 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.768459:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0c44 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.768479:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff982a0296bd00) 00010000:00010000:1.0:1787574466.768482:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574466.768503:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0c44 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.768509:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0c44 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574466.900678:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574466.902527:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272334720 00000100:00100000:2.0:1787574466.902546:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272334720 00000100:00100000:2.0:1787574466.903009:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:2.0:1787574466.903036:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb815d5e-9f9e-47fd-838c-222c53157044+9:14420:x1874407272334720:12345-192.168.206.51@tcp:101:lctl.0 00010000:00010000:2.0:1787574466.903071:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574466.903100:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0c4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1efd0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574466.903205:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0c52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574466.903223:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0c52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574466.903238:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0c52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574466.904247:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787574466.904256:0:14324:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787574466.904411:0:14324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0c52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574466.904467:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0c4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efd0 expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574466.904492:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa600/0xfe91058e646c0c52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efd0 expref: 10 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574466.904528:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34800) 00010000:00010000:2.0:1787574466.904531:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787574466.904535:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fa600, rc 0) 00000100:00100000:2.0:1787574466.905291:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb815d5e-9f9e-47fd-838c-222c53157044+10:14420:x1874407272334720:12345-192.168.206.51@tcp:101:lctl.0 Request processed in 2263us (4746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574466.905303:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:2.0:1787574466.968439:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574466.968544:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272334848 00000100:00100000:3.0:1787574466.968567:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272334848 00000100:00100000:3.0:1787574466.968653:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:3.0:1787574466.968666:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30990db0-f016-4bad-afb0-413c8b48dde7+5:14421:x1874407272334848:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1787574466.968692:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574466.968720:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626a00/0xfe91058e646c0c59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1efd7 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.968819:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626e00/0xfe91058e646c0c60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.968836:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626e00/0xfe91058e646c0c60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.968850:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626e00/0xfe91058e646c0c60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574466.969234:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787574466.969240:0:14325:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787574466.969276:0:14325:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626e00/0xfe91058e646c0c60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.969689:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626a00/0xfe91058e646c0c59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efd7 expref: 7 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.969712:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626e00/0xfe91058e646c0c60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efd7 expref: 6 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.969722:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34800) 00010000:00010000:3.0:1787574466.969724:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574466.969885:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a04626e00, rc 0) 00000100:00100000:3.0:1787574466.970532:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30990db0-f016-4bad-afb0-413c8b48dde7+6:14421:x1874407272334848:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1865us (2103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574466.970542:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:3.0:1787574466.974722:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574466.976206:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272334976 00000100:00100000:1.0:1787574466.976226:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272334976 00000100:00100000:1.0:1787574466.976316:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:1.0:1787574466.976329:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30990db0-f016-4bad-afb0-413c8b48dde7+6:14421:x1874407272334976:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1787574466.976364:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574466.976391:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0c67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1efde expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.976476:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0c6e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.976493:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0c6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.976507:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0c6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.976523:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0c75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.976530:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0c75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.976537:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0c75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.978428:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1800/0xfe91058e646c0c7c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.978452:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1800/0xfe91058e646c0c7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.978463:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1800/0xfe91058e646c0c7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574466.978523:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787574466.978527:0:14326:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787574466.978549:0:14326:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1800/0xfe91058e646c0c7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.978562:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0c6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.978568:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0c6e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.978575:0:14326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0c6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.978581:0:14326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574466.978585:0:14326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0c6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.978592:0:14326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0c6e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.978605:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34800) 00010000:00010000:1.0:1787574466.978624:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574466.978628:0:14326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0c6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.978635:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0c6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.978651:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0c75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.978657:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0c75 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.978662:0:14326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0c75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.978667:0:14326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574466.978670:0:14326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0c75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.978675:0:14326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0c75 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.978763:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff982a04da2f00) 00010000:00010000:1.0:1787574466.978766:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574466.978769:0:14326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0c75 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.978774:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0c75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.978813:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0c67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efde expref: 8 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.978838:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1800/0xfe91058e646c0c7c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efde expref: 7 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574466.978845:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff982a04da2e00) 00010000:00010000:1.0:1787574466.978847:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787574466.978849:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1800, rc 0) 00000100:00100000:1.0:1787574466.979048:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30990db0-f016-4bad-afb0-413c8b48dde7+7:14421:x1874407272334976:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 2720us (4337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574466.979057:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:1.0:1787574466.986201:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574466.990381:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272335232 00000100:00100000:0.0:1787574466.990403:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272335232 00000100:00100000:0.0:1787574466.990504:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:0.0:1787574466.990517:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30990db0-f016-4bad-afb0-413c8b48dde7+7:14421:x1874407272335232:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1787574466.990544:0:15671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574466.990850:0:15671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0c83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1efe5 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574466.991012:0:15671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787574466.991222:0:15671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0c83 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efe5 expref: 9 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.991240:0:15671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34800) 00010000:00010000:0.0:1787574466.991244:0:15671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787574466.991252:0:15671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0c83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efe5 expref: 9 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.991407:0:15671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a048f6c00, rc 0) 00000100:00100000:0.0:1787574466.991506:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30990db0-f016-4bad-afb0-413c8b48dde7+8:14421:x1874407272335232:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 990us (5319us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787574466.991514:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:2.0:1787574466.995905:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574466.995994:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272335488 00000100:00100000:3.0:1787574466.996004:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272335488 00000100:00100000:3.0:1787574466.996065:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:3.0:1787574466.996075:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30990db0-f016-4bad-afb0-413c8b48dde7+8:14421:x1874407272335488:12345-192.168.206.51@tcp:36:lfs.0 00010000:00010000:3.0:1787574466.996125:0:14324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574466.996150:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1800/0xfe91058e646c0c7c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efde expref: 8 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.996205:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff982a04da2e00) 00010000:00010000:3.0:1787574466.996215:0:14324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574466.996241:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626a00/0xfe91058e646c0c91 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.996253:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626a00/0xfe91058e646c0c91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574466.996262:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626a00/0xfe91058e646c0c91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787574466.996473:0:14324:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e5a08e9 reply state 00000000ec6ba942 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626a00/0xfe91058e646c0c91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574466.996482:0:14324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787574466.996493:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1787574466.996569:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30990db0-f016-4bad-afb0-413c8b48dde7+9:14421:x1874407272335488:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 494us (672us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787574466.996587:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00010000:00010000:0.0:1787574466.998029:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626a00/0xfe91058e646c0c91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.998052:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626a00/0xfe91058e646c0c91 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.998061:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626a00/0xfe91058e646c0c91 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.998069:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a04626a00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574466.998075:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626a00/0xfe91058e646c0c91 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.998085:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626a00/0xfe91058e646c0c91 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.998104:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff982a04dc0f00) 00010000:00010000:0.0:1787574466.998108:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1787574466.998128:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626a00/0xfe91058e646c0c91 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574466.998136:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626a00/0xfe91058e646c0c91 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574466.999228:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574466.999346:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272335744 00000100:00100000:0.0:1787574466.999372:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272335744 00000100:00100000:0.0:1787574466.999521:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:0.0:1787574466.999535:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30990db0-f016-4bad-afb0-413c8b48dde7+8:14421:x1874407272335744:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1787574466.999884:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30990db0-f016-4bad-afb0-413c8b48dde7+9:14421:x1874407272335744:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 350us (662us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787574466.999906:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:3.0:1787574467.002258:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574467.002339:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272336000 00000100:00100000:1.0:1787574467.002349:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272336000 00000100:00100000:1.0:1787574467.002418:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:1.0:1787574467.002428:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30990db0-f016-4bad-afb0-413c8b48dde7+9:14421:x1874407272336000:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1787574467.002450:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574467.002468:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0c98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1efec expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.002535:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0c9f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.002549:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0c9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.002559:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0c9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.002590:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0ca6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.002597:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.002605:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574467.002733:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787574467.002813:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0c9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.002821:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0c9f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.002828:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0c9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.002834:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574467.002850:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0c9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.002858:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0c9f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.002871:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34800) 00010000:00010000:1.0:1787574467.002874:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574467.002879:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0c9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.002896:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0c9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.002910:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.002915:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0ca6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.002922:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.002927:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574467.002930:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.002936:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0ca6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.002944:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff982a04da2f00) 00010000:00010000:1.0:1787574467.002947:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574467.002950:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0ca6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.002955:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0ca6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.002990:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0c98 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efec expref: 11 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.003012:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34800) 00010000:00010000:1.0:1787574467.003014:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787574467.003018:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0c98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1efec expref: 11 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.003027:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1200, rc 0) 00000100:00100000:1.0:1787574467.003086:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30990db0-f016-4bad-afb0-413c8b48dde7+10:14421:x1874407272336000:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 659us (837us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1787574467.003094:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:3.0:1787574467.005638:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574467.006020:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272336128 00000100:00100000:2.0:1787574467.006039:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272336128 00000100:00100000:2.0:1787574467.006118:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:2.0:1787574467.006133:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30990db0-f016-4bad-afb0-413c8b48dde7+10:14421:x1874407272336128:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1787574467.006193:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574467.006222:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c0cb4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1eff3 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.006841:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0cbb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.006858:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0cbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.006871:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0cbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574467.007005:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787574467.007027:0:14324:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787574467.007057:0:14324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0cbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.007091:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c0cb4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eff3 expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.007114:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0cbb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eff3 expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.007124:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff982a03b34900) 00010000:00010000:2.0:1787574467.007127:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787574467.007131:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fa400, rc 0) 00000100:00100000:2.0:1787574467.007246:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30990db0-f016-4bad-afb0-413c8b48dde7+11:14421:x1874407272336128:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1116us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574467.007254:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:1.0:1787574467.010739:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574467.012332:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272336256 00000100:00100000:2.0:1787574467.012352:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272336256 00000100:00100000:2.0:1787574467.012447:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:2.0:1787574467.012462:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30990db0-f016-4bad-afb0-413c8b48dde7+11:14421:x1874407272336256:12345-192.168.206.51@tcp:37:lfs.0 00000100:00100000:2.0:1787574467.019273:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30990db0-f016-4bad-afb0-413c8b48dde7+11:14421:x1874407272336256:12345-192.168.206.51@tcp:37:lfs.0 Request processed in 6797us (8525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574467.019289:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:0.0:1787574467.023018:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574467.023122:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272336512 00000100:00100000:2.0:1787574467.023135:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272336512 00000100:00100000:2.0:1787574467.023327:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:2.0:1787574467.023342:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e94450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30990db0-f016-4bad-afb0-413c8b48dde7+11:14421:x1874407272336512:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1787574467.023759:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e94450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30990db0-f016-4bad-afb0-413c8b48dde7+12:14421:x1874407272336512:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 418us (752us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787574467.023786:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1787574467.075860:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574467.076073:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272336640 00000100:00100000:2.0:1787574467.076086:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272336640 00000100:00100000:2.0:1787574467.076209:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:2.0:1787574467.076223:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb815d5e-9f9e-47fd-838c-222c53157044+10:14427:x1874407272336640:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1787574467.076251:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574467.076276:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c0cc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1effa expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.076381:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c0cc9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.076398:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c0cc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.076422:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c0cc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.076440:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0cd0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.076447:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.076454:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.077073:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c0cd7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.077107:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c0cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.077116:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c0cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574467.077161:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787574467.077234:0:14325:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787574467.077290:0:14325:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c0cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.077374:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c0cc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.077384:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c0cc9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.077391:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c0cc9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.077399:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fba00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574467.077464:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c0cc9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.077538:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c0cc9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.077555:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34800) 00010000:00010000:2.0:1787574467.077558:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574467.077564:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c0cc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.077582:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fba00/0xfe91058e646c0cc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.077600:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.077605:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0cd0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.077611:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.077616:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fac00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574467.077618:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.077624:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0cd0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.077631:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff982a03b34500) 00010000:00010000:2.0:1787574467.077634:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574467.077637:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0cd0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.077642:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0cd0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.077686:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fae00/0xfe91058e646c0cc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1effa expref: 12 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.077714:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb400/0xfe91058e646c0cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1effa expref: 11 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.077723:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff982a03b34900) 00010000:00010000:2.0:1787574467.077725:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787574467.077728:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fb400, rc 0) 00000100:00100000:2.0:1787574467.081082:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb815d5e-9f9e-47fd-838c-222c53157044+11:14427:x1874407272336640:12345-192.168.206.51@tcp:101:bash.0 Request processed in 4843us (5217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574467.081099:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:2.0:1787574467.090718:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574467.090822:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272336896 00000100:00100000:1.0:1787574467.090837:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272336896 00000100:00100000:1.0:1787574467.090916:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:1.0:1787574467.090928:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb815d5e-9f9e-47fd-838c-222c53157044+11:14427:x1874407272336896:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1787574467.090955:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574467.090980:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0cde lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1f001 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.091150:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0ce5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.091192:0:14326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0cbb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eff3 expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.091204:0:14326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0ce5 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.091261:0:14326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0cbb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eff3 expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.091277:0:14326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0cbb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eff3 expref: 11 pid: 14324 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574467.091294:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d93480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14326:1874407290149760:192.168.206.51@tcp:104: 00000100:00100000:1.0:1787574467.091436:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a18027600 going to sleep for 11 seconds 00000100:00100000:1.0:1787574467.094737:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d93480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14326:1874407290149760:192.168.206.51@tcp:104: 00010000:00010000:1.0:1787574467.094777:0:14326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0ce5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574467.097741:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574467.098707:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272337024 00000100:00100000:1.0:1787574467.098721:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272337024 00010000:00010000:1.0:1787574467.098783:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0cbb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eff3 expref: 12 pid: 14324 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574467.098845:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:1.0:1787574467.098856:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30990db0-f016-4bad-afb0-413c8b48dde7+12:2350:x1874407272337024:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574467.098873:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574467.098881:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0cbb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eff3 expref: 12 pid: 14324 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.098897:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0cbb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eff3 expref: 12 pid: 14324 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.098946:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0cbb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1eff3 expref: 12 pid: 14324 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.098967:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff982a03b34900) 00010000:00010000:1.0:1787574467.098973:0:14310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0ce5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.098985:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0ce5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.098993:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0ce5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.100001:0:14326:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0ce5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.100017:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0ce5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.100060:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627e00/0xfe91058e646c0cec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.100071:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627e00/0xfe91058e646c0cec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.100080:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627e00/0xfe91058e646c0cec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.104070:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627000/0xfe91058e646c0cf3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.104100:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627000/0xfe91058e646c0cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.104115:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627000/0xfe91058e646c0cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574467.104132:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787574467.104198:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0ce5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.104207:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0ce5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.104227:0:14326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0ce5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.104235:0:14326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574467.104241:0:14326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0ce5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.104250:0:14326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0ce5 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.104266:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff982a03b34900) 00010000:00010000:3.0:1787574467.104270:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574467.104275:0:14326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0ce5 lrc: 3/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787574467.105107:0:14326:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2d81cd7 reply state 00000000045f1292 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627e00/0xfe91058e646c0cec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574467.105118:0:14326:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787574467.105201:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0cde lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f001 expref: 14 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.105229:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627000/0xfe91058e646c0cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f001 expref: 13 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.105238:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982a04dc0200) 00010000:00010000:3.0:1787574467.105241:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787574467.105244:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a04627000, rc 0) 00000100:00100000:3.0:1787574467.105621:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb815d5e-9f9e-47fd-838c-222c53157044+14:14427:x1874407272336896:12345-192.168.206.51@tcp:101:bash.0 Request processed in 14693us (14916us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787574467.105644:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00010000:00010000:1.0:1787574467.105898:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0ce5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.105922:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574467.105952:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30990db0-f016-4bad-afb0-413c8b48dde7+11:2350:x1874407272337024:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 7097us (8224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574467.105961:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00010000:00010000:1.0:1787574467.110290:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627e00/0xfe91058e646c0cec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.111273:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627e00/0xfe91058e646c0cec lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.111282:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627e00/0xfe91058e646c0cec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.111289:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a04627e00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574467.111321:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627e00/0xfe91058e646c0cec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.111331:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627e00/0xfe91058e646c0cec lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.111365:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff982a04dc0900) 00010000:00010000:1.0:1787574467.111369:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574467.111375:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627e00/0xfe91058e646c0cec lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.111383:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627e00/0xfe91058e646c0cec lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787574467.124105:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787574467.134983:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574467.135098:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272337152 00000100:00100000:3.0:1787574467.135113:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272337152 00000100:00100000:3.0:1787574467.135230:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:3.0:1787574467.135243:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb815d5e-9f9e-47fd-838c-222c53157044+13:14427:x1874407272337152:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1787574467.135274:0:15671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574467.135316:0:15671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626600/0xfe91058e646c0d01 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1f008 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574467.135858:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6400/0xfe91058e646c0d08 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574467.135877:0:15671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6400/0xfe91058e646c0d08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574467.135891:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6400/0xfe91058e646c0d08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574467.135943:0:15671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787574467.135949:0:15671:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787574467.135975:0:15671:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6400/0xfe91058e646c0d08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574467.135989:0:15671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6400/0xfe91058e646c0d08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574467.136022:0:15671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626600/0xfe91058e646c0d01 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f008 expref: 15 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574467.136065:0:15671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6400/0xfe91058e646c0d08 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f008 expref: 14 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574467.136077:0:15671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982a04dc0200) 00010000:00010000:0.0:1787574467.136080:0:15671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574467.136084:0:15671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a048f6400, rc 0) 00000100:00100000:0.0:1787574467.136213:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb815d5e-9f9e-47fd-838c-222c53157044+14:14427:x1874407272337152:12345-192.168.206.51@tcp:101:bash.0 Request processed in 972us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574467.136223:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:0.0:1787574467.142751:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574467.143134:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272337408 00000100:00100000:1.0:1787574467.143147:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272337408 00000100:00100000:1.0:1787574467.143586:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:1.0:1787574467.143599:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cb815d5e-9f9e-47fd-838c-222c53157044+14:14427:x1874407272337408:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:1.0:1787574467.144108:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cb815d5e-9f9e-47fd-838c-222c53157044+15:14427:x1874407272337408:12345-192.168.206.51@tcp:35:bash.0 Request processed in 510us (1370us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787574467.144117:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1787574467.231315:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574467.233422:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272337664 00000100:00100000:3.0:1787574467.233441:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272337664 00000100:00100000:3.0:1787574467.233540:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:3.0:1787574467.233553:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb815d5e-9f9e-47fd-838c-222c53157044+15:14437:x1874407272337664:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1787574467.233586:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574467.233613:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627800/0xfe91058e646c0d0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1f00f expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574467.233762:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787574467.235376:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627800/0xfe91058e646c0d0f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f00f expref: 17 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.235405:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a03b34800) 00010000:00010000:3.0:1787574467.235408:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787574467.235415:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627800/0xfe91058e646c0d0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f00f expref: 17 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.235455:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a04627800, rc 0) 00000100:00100000:3.0:1787574467.235613:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb815d5e-9f9e-47fd-838c-222c53157044+16:14437:x1874407272337664:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 2061us (4310us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1787574467.235623:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:2.0:1787574467.256759:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574467.256934:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272337920 00000100:00100000:0.0:1787574467.256948:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272337920 00000100:00100000:0.0:1787574467.257081:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:0.0:1787574467.257095:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cb815d5e-9f9e-47fd-838c-222c53157044+16:14437:x1874407272337920:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1787574467.257583:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cb815d5e-9f9e-47fd-838c-222c53157044+17:14437:x1874407272337920:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 489us (836us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787574467.257592:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:0.0:1787574467.285669:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574467.285778:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272338176 00000100:00100000:2.0:1787574467.285791:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272338176 00000100:00100000:2.0:1787574467.285889:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:2.0:1787574467.285903:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb815d5e-9f9e-47fd-838c-222c53157044+17:14440:x1874407272338176:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1787574467.285934:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574467.285960:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c0d1d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1f016 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.286103:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb800/0xfe91058e646c0d24 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.286120:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb800/0xfe91058e646c0d24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.286151:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb800/0xfe91058e646c0d24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574467.286189:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787574467.286385:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb200/0xfe91058e646c0d1d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f016 expref: 20 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.286406:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb800/0xfe91058e646c0d24 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f016 expref: 19 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.286416:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982a04dc0200) 00010000:00010000:2.0:1787574467.286419:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574467.286422:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fb800, rc 0) 00000100:00100000:2.0:1787574467.286522:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb815d5e-9f9e-47fd-838c-222c53157044+19:14440:x1874407272338176:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 622us (872us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787574467.286530:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:2.0:1787574467.289560:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574467.289651:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272338304 00000100:00100000:3.0:1787574467.289663:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272338304 00000100:00100000:3.0:1787574467.289743:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1787574467.289755:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb815d5e-9f9e-47fd-838c-222c53157044+19:2350:x1874407272338304:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574467.289774:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574467.289804:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb800/0xfe91058e646c0d24 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f016 expref: 19 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.289826:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982a04dc0200) 00010000:00010000:3.0:1787574467.289840:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574467.289902:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb815d5e-9f9e-47fd-838c-222c53157044+18:2350:x1874407272338304:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 149us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574467.289910:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1787574467.291365:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574467.292121:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272338432 00000100:00100000:1.0:1787574467.292136:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272338432 00000100:00100000:1.0:1787574467.292244:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:1.0:1787574467.292256:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb815d5e-9f9e-47fd-838c-222c53157044+18:14440:x1874407272338432:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:1.0:1787574467.292335:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0d32 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.292363:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0d32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.292393:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0d32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.292427:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0d32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.292434:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0d32 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.292441:0:14326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0d32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.292447:0:14326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1000 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574467.292452:0:14326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0d32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.292460:0:14326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0d32 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.292473:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982a04dc0200) 00010000:00010000:1.0:1787574467.292476:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787574467.292481:0:14326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0d32 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.292488:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0d32 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574467.292748:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb815d5e-9f9e-47fd-838c-222c53157044+18:14440:x1874407272338432:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 492us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574467.292759:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:0.0:1787574467.295031:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574467.295199:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272338688 00000100:00100000:1.0:1787574467.295213:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272338688 00000100:00100000:1.0:1787574467.295271:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:1.0:1787574467.295281:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cb815d5e-9f9e-47fd-838c-222c53157044+18:14440:x1874407272338688:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1787574467.295598:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cb815d5e-9f9e-47fd-838c-222c53157044+19:14440:x1874407272338688:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 316us (577us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787574467.295606:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:2.0:1787574467.492504:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574467.494316:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272338944 00000100:00100000:0.0:1787574467.494340:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272338944 00000100:00100000:0.0:1787574467.494503:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:0.0:1787574467.494516:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb815d5e-9f9e-47fd-838c-222c53157044+19:14471:x1874407272338944:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:0.0:1787574467.494546:0:15671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574467.494572:0:15671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6a00/0xfe91058e646c0d39 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1f01d expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574467.494713:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7e00/0xfe91058e646c0d40 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574467.494731:0:15671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7e00/0xfe91058e646c0d40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574467.494744:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7e00/0xfe91058e646c0d40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574467.494757:0:15671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787574467.494946:0:15671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6a00/0xfe91058e646c0d39 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f01d expref: 22 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574467.494968:0:15671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7e00/0xfe91058e646c0d40 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f01d expref: 21 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574467.494979:0:15671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982a04dc0200) 00010000:00010000:0.0:1787574467.494982:0:15671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574467.494986:0:15671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a048f7e00, rc 0) 00000100:00100000:0.0:1787574467.495096:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb815d5e-9f9e-47fd-838c-222c53157044+21:14471:x1874407272338944:12345-192.168.206.51@tcp:101:cat.0 Request processed in 582us (2607us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787574467.495104:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:3.0:1787574467.498534:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574467.498587:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574467.499132:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272339200 00000100:00100000:1.0:1787574467.499147:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272339200 00000100:00100000:1.0:1787574467.499266:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:2.0:1787574467.499271:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272339328 00000100:00100000:2.0:1787574467.499278:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272339328 00000100:00100000:1.0:1787574467.499282:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cb815d5e-9f9e-47fd-838c-222c53157044+21:14471:x1874407272339200:12345-192.168.206.51@tcp:35:cat.0 00000100:00100000:2.0:1787574467.499378:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:2.0:1787574467.499387:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb815d5e-9f9e-47fd-838c-222c53157044+22:2353:x1874407272339328:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574467.499401:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574467.499433:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7e00/0xfe91058e646c0d40 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f01d expref: 22 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.499457:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982a04dc0200) 00010000:00010000:2.0:1787574467.499480:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574467.499553:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb815d5e-9f9e-47fd-838c-222c53157044+22:2353:x1874407272339328:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 166us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574467.499561:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:1.0:1787574467.500498:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cb815d5e-9f9e-47fd-838c-222c53157044+21:14471:x1874407272339200:12345-192.168.206.51@tcp:35:cat.0 Request processed in 1165us (1920us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787574467.500508:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1787574467.545291:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574467.545507:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272339584 00000100:00100000:2.0:1787574467.545521:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272339584 00000100:00100000:2.0:1787574467.545608:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:2.0:1787574467.545620:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb815d5e-9f9e-47fd-838c-222c53157044+21:14477:x1874407272339584:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1787574467.545651:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574467.546003:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c0d4e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1f024 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.546131:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0d55 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.546147:0:14324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627000/0xfe91058e646c0cf3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f001 expref: 22 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.546155:0:14324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6400/0xfe91058e646c0d08 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f008 expref: 22 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.546190:0:14324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0d55 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.546235:0:14324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6400/0xfe91058e646c0d08 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f008 expref: 22 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.546250:0:14324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6400/0xfe91058e646c0d08 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f008 expref: 22 pid: 15671 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574467.546288:0:14324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14324:1874407290149888:192.168.206.51@tcp:104: 00010000:00010000:2.0:1787574467.546672:0:14324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627000/0xfe91058e646c0cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f001 expref: 22 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.546684:0:14324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627000/0xfe91058e646c0cf3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f001 expref: 22 pid: 14326 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574467.546695:0:14324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14324:1874407290150016:192.168.206.51@tcp:104: 00000100:00100000:2.0:1787574467.546726:0:14324:0:(client.c:2715:ptlrpc_set_wait()) set ffff982906a616c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574467.550062:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574467.550162:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574467.551159:0:14324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14324:1874407290149888:192.168.206.51@tcp:104: 00000100:00100000:1.0:1787574467.551159:0:16445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272339712 00000100:00100000:1.0:1787574467.551195:0:16445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272339712 00000100:00100000:2.0:1787574467.551198:0:14324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14324:1874407290150016:192.168.206.51@tcp:104: 00010000:00010000:2.0:1787574467.551227:0:14324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0d55 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.551243:0:16445:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627000/0xfe91058e646c0cf3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f001 expref: 23 pid: 14326 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574467.551286:0:16445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272339840 00000100:00100000:1.0:1787574467.551290:0:16445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272339840 00010000:00010000:1.0:1787574467.551304:0:16445:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6400/0xfe91058e646c0d08 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f008 expref: 24 pid: 15671 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574467.551546:0:16445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:1.0:1787574467.551557:0:16445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982904eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cb815d5e-9f9e-47fd-838c-222c53157044+24:2351:x1874407272339712:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574467.551576:0:16445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574467.551605:0:16445:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627000/0xfe91058e646c0cf3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f001 expref: 24 pid: 14326 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.551617:0:16445:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627000/0xfe91058e646c0cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f001 expref: 24 pid: 14326 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574467.551621:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:2.0:1787574467.551629:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb815d5e-9f9e-47fd-838c-222c53157044+24:2350:x1874407272339840:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574467.551639:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574467.551643:0:16445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627000/0xfe91058e646c0cf3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f001 expref: 24 pid: 14326 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.551644:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6400/0xfe91058e646c0d08 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f008 expref: 24 pid: 15671 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.551654:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6400/0xfe91058e646c0d08 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f008 expref: 23 pid: 15671 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.551663:0:16445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982a04dc0200) 00010000:00010000:1.0:1787574467.551668:0:16445:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0d55 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.551729:0:16445:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0d55 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.551737:0:16445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574467.551853:0:16445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982904eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cb815d5e-9f9e-47fd-838c-222c53157044+23:2351:x1874407272339712:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 298us (1804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574467.551861:0:16445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00010000:00010000:2.0:1787574467.552738:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6400/0xfe91058e646c0d08 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f008 expref: 22 pid: 15671 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.552769:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982a04dc0200) 00010000:00010000:2.0:1787574467.552774:0:14309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0d55 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.552783:0:14309:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0d55 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.552791:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0d55 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.552919:0:14324:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0d55 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.552939:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0d55 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574467.552963:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787574467.553218:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb600/0xfe91058e646c0d4e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f024 expref: 23 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.553236:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa000/0xfe91058e646c0d55 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f024 expref: 22 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.553245:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982a04dc0200) 00010000:00010000:3.0:1787574467.553248:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787574467.553250:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a069fa000, rc 0) 00010000:00010000:2.0:1787574467.553457:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574467.553636:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb815d5e-9f9e-47fd-838c-222c53157044+22:14477:x1874407272339584:12345-192.168.206.51@tcp:101:dd.0 Request processed in 8016us (9485us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1787574467.553645:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:2.0:1787574467.553724:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb815d5e-9f9e-47fd-838c-222c53157044+21:2350:x1874407272339840:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 2094us (3561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574467.553733:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1787574467.557160:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574467.557466:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272340096 00000100:00100000:2.0:1787574467.557478:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272340096 00000100:00100000:2.0:1787574467.557541:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:2.0:1787574467.557553:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb815d5e-9f9e-47fd-838c-222c53157044+21:14477:x1874407272340096:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:2.0:1787574467.557913:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb800/0xfe91058e646c0d63 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.557934:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb800/0xfe91058e646c0d63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.557949:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb800/0xfe91058e646c0d63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787574467.558019:0:14325:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1787574467.558053:0:14325:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c6b0fe5 reply state 000000009f437280 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb800/0xfe91058e646c0d63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574467.558081:0:14325:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787574467.558624:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb815d5e-9f9e-47fd-838c-222c53157044+24:14477:x1874407272340096:12345-192.168.206.51@tcp:36:dd.0 Request processed in 1068us (1473us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1787574467.558634:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00000020:00080000:2.0:1787574467.558640:0:14325:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787574467.561729:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574467.561809:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272340224 00000100:00100000:1.0:1787574467.561821:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272340224 00000100:00100000:1.0:1787574467.561902:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:1.0:1787574467.561913:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb815d5e-9f9e-47fd-838c-222c53157044+24:14477:x1874407272340224:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:1.0:1787574467.561942:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574467.561968:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0d6a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1f02b expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.562052:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0d6a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f02b expref: 25 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.562087:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0d6a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f02b expref: 25 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.562112:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982a04dc0200) 00010000:00010000:1.0:1787574467.562116:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787574467.562120:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a057e1000, rc 0) 00010000:00010000:2.0:1787574467.562249:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb800/0xfe91058e646c0d63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.562259:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb800/0xfe91058e646c0d63 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.562267:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb800/0xfe91058e646c0d63 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.562273:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fb800 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574467.562278:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb800/0xfe91058e646c0d63 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.562286:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb800/0xfe91058e646c0d63 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.562300:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982a04dc0200) 00010000:00010000:2.0:1787574467.562304:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574467.562317:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb800/0xfe91058e646c0d63 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574467.562325:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fb800/0xfe91058e646c0d63 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574467.562818:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb815d5e-9f9e-47fd-838c-222c53157044+24:14477:x1874407272340224:12345-192.168.206.51@tcp:101:dd.0 Request processed in 903us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574467.562838:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:3.0:1787574467.574615:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574467.574858:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272340480 00000100:00100000:1.0:1787574467.574871:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272340480 00000100:00100000:1.0:1787574467.574962:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:1.0:1787574467.574974:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb815d5e-9f9e-47fd-838c-222c53157044+24:14477:x1874407272340480:12345-192.168.206.51@tcp:103:dd.0 00010000:00010000:1.0:1787574467.574993:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574467.575037:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0d6a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f02b expref: 24 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.575061:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982a04dc0200) 00010000:00010000:1.0:1787574467.575067:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574467.575140:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb815d5e-9f9e-47fd-838c-222c53157044+23:14477:x1874407272340480:12345-192.168.206.51@tcp:103:dd.0 Request processed in 168us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574467.575148:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:0.0:1787574467.577711:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574467.577800:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272340608 00000100:00100000:1.0:1787574467.577811:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272340608 00000100:00100000:1.0:1787574467.577876:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:1.0:1787574467.577887:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb815d5e-9f9e-47fd-838c-222c53157044+23:14477:x1874407272340608:12345-192.168.206.51@tcp:58:dd.0 00010000:00010000:1.0:1787574467.578037:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0d71 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.578057:0:15671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0d71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574467.578069:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0d71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787574467.579156:0:15671:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574467.579380:0:15671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1787574467.579470:0:15671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1787574467.579602:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb815d5e-9f9e-47fd-838c-222c53157044+23:14477:x1874407272340608:12345-192.168.206.51@tcp:58:dd.0 Request processed in 1713us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574467.579613:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:2.0:1787574467.586542:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574467.586660:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272340736 00000100:00100000:3.0:1787574467.586674:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272340736 00000100:00100000:3.0:1787574467.586746:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:3.0:1787574467.586760:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb815d5e-9f9e-47fd-838c-222c53157044+23:14477:x1874407272340736:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1787574467.586785:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574467.586812:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627800/0xfe91058e646c0d78 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1f032 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.586912:0:14324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0d71 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.586926:0:14324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627800/0xfe91058e646c0d78 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f032 expref: 24 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.586952:0:14324:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0d71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.586968:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627800/0xfe91058e646c0d78 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f032 expref: 24 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.586984:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982a04dc0200) 00010000:00010000:3.0:1787574467.586988:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574467.586992:0:14324:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627800/0xfe91058e646c0d78 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f032 expref: 24 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574467.587002:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a04627800, rc 0) 00000100:00100000:3.0:1787574467.587088:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb815d5e-9f9e-47fd-838c-222c53157044+24:14477:x1874407272340736:12345-192.168.206.51@tcp:101:dd.0 Request processed in 331us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574467.587095:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00010000:00010000:2.0:1787574467.761508:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574467.869067:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574467.869121:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574467.869160:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574467.869226:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574467.869274:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574467.869287:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272340864 00000100:00100000:1.0:1787574467.869300:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272340864 00000100:00100000:0.0:1787574467.869312:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272340992 00000100:00100000:0.0:1787574467.869315:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272340992 00000100:00100000:0.0:1787574467.869366:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272341504 00000100:00100000:0.0:1787574467.869369:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272341504 00000100:00100000:1.0:1787574467.869371:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:1.0:1787574467.869381:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+13:2350:x1874407272340864:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574467.869385:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272341120 00000100:00100000:0.0:1787574467.869387:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272341120 00000100:00100000:0.0:1787574467.869403:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:0.0:1787574467.869409:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb815d5e-9f9e-47fd-838c-222c53157044+5:2350:x1874407272340992:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1787574467.869494:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:2.0:1787574467.869506:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30990db0-f016-4bad-afb0-413c8b48dde7+5:2350:x1874407272341504:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1787574467.869563:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272341248 00000100:00100000:3.0:1787574467.869568:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272341248 00000100:00100000:3.0:1787574467.869603:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:3.0:1787574467.869611:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a11bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30990db0-f016-4bad-afb0-413c8b48dde7+11:2350:x1874407272341248:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574467.869698:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb815d5e-9f9e-47fd-838c-222c53157044+5:2350:x1874407272340992:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 283us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574467.869706:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:0.0:1787574467.869729:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:0.0:1787574467.869735:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb815d5e-9f9e-47fd-838c-222c53157044+5:2350:x1874407272341120:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574467.869761:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb815d5e-9f9e-47fd-838c-222c53157044+5:2350:x1874407272341120:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 26us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574467.869767:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:0.0:1787574467.869819:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574467.869839:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272341376 00000100:00100000:0.0:1787574467.869842:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272341376 00000100:00100000:0.0:1787574467.869867:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:0.0:1787574467.869874:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30990db0-f016-4bad-afb0-413c8b48dde7+5:2350:x1874407272341376:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1787574467.869899:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30990db0-f016-4bad-afb0-413c8b48dde7+5:2350:x1874407272341376:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574467.869905:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00080000:0.0:1787574467.870080:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574467.870095:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574467.871886:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dac4a08-d60d-45ca-bc3d-721804b2f529+13:2350:x1874407272340864:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 2491us (2644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574467.871902:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:2.0:1787574467.872863:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:30990db0-f016-4bad-afb0-413c8b48dde7+5:2350:x1874407272341504:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 3352us (3693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574467.872876:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:3.0:1787574467.873441:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a11bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30990db0-f016-4bad-afb0-413c8b48dde7+11:2350:x1874407272341248:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 3825us (4314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574467.873529:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000040:00080000:3.0:1787574468.145488:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787574468.145502:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787574468.145549:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787574468.145557:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787574468.145736:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b4380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14357:1874407290150144:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787574468.145952:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a07d7b840 going to sleep for 11 seconds 00000100:00100000:0.0:1787574468.151421:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574468.156972:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b4380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14357:1874407290150144:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787574468.157236:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272341632 00000100:00100000:1.0:1787574468.157246:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272341632 00000100:00100000:1.0:1787574468.157319:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:1.0:1787574468.157332:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cb815d5e-9f9e-47fd-838c-222c53157044+24:14478:x1874407272341632:12345-192.168.206.51@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787574468.157460:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cb815d5e-9f9e-47fd-838c-222c53157044+24:14478:x1874407272341632:12345-192.168.206.51@tcp:900:lhsmtool_posix.0 Request processed in 130us (6053us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574468.157479:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00080000:0.0:1787574468.158595:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574468.161537:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574468.161724:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272341760 00000100:00100000:3.0:1787574468.161737:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272341760 00000100:00100000:3.0:1787574468.161812:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:3.0:1787574468.161833:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb815d5e-9f9e-47fd-838c-222c53157044+24:14478:x1874407272341760:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787574468.161877:0:14324:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787574468.162014:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb815d5e-9f9e-47fd-838c-222c53157044+24:14478:x1874407272341760:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 191us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574468.162022:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:3.0:1787574468.169529:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574468.169715:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272341888 00000100:00100000:0.0:1787574468.169728:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272341888 00000100:00100000:0.0:1787574468.169788:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:0.0:1787574468.169798:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb815d5e-9f9e-47fd-838c-222c53157044+24:14478:x1874407272341888:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787574468.169900:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6e00/0xfe91058e646c0d7f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.169920:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6e00/0xfe91058e646c0d7f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.169935:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6e00/0xfe91058e646c0d7f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.170569:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6800/0xfe91058e646c0d86 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.170592:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6800/0xfe91058e646c0d86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.170604:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6800/0xfe91058e646c0d86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.170636:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6200/0xfe91058e646c0d8d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.170645:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6200/0xfe91058e646c0d8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.170671:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6200/0xfe91058e646c0d8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574468.170714:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787574468.170719:0:14325:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787574468.170731:0:14325:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6200/0xfe91058e646c0d8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.170742:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6e00/0xfe91058e646c0d7f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.172580:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6e00/0xfe91058e646c0d7f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.172591:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6e00/0xfe91058e646c0d7f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.172597:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a048f6e00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574468.172601:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6e00/0xfe91058e646c0d7f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.172609:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6e00/0xfe91058e646c0d7f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.172625:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982a04dc0b00) 00010000:00010000:0.0:1787574468.172628:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574468.172632:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6e00/0xfe91058e646c0d7f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.172638:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6e00/0xfe91058e646c0d7f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.172680:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6800/0xfe91058e646c0d86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.172686:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6800/0xfe91058e646c0d86 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.172692:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6800/0xfe91058e646c0d86 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.172697:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a048f6800 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574468.172700:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6800/0xfe91058e646c0d86 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.172705:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6800/0xfe91058e646c0d86 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.172713:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff982a0296be00) 00010000:00010000:0.0:1787574468.172716:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574468.172718:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6800/0xfe91058e646c0d86 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.172724:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6800/0xfe91058e646c0d86 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.172740:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6200/0xfe91058e646c0d8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.172747:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6200/0xfe91058e646c0d8d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.172753:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6200/0xfe91058e646c0d8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.172766:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a048f6200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:0.0:1787574468.172769:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6200/0xfe91058e646c0d8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.172775:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6200/0xfe91058e646c0d8d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.172783:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982a04dc0200) 00010000:00010000:0.0:1787574468.172785:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574468.172788:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6200/0xfe91058e646c0d8d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.172793:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6200/0xfe91058e646c0d8d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574468.172972:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb815d5e-9f9e-47fd-838c-222c53157044+24:14478:x1874407272341888:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 3170us (3454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574468.172982:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:0.0:1787574468.181756:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574468.181922:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272342144 00000100:00100000:3.0:1787574468.181938:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272342144 00000100:00100000:3.0:1787574468.182075:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:3.0:1787574468.182091:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb815d5e-9f9e-47fd-838c-222c53157044+24:14478:x1874407272342144:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574468.182120:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574468.182159:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626200/0xfe91058e646c0d94 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1f039 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.182382:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626400/0xfe91058e646c0d9b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.182401:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626400/0xfe91058e646c0d9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.182416:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626400/0xfe91058e646c0d9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574468.182444:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787574468.182579:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626400/0xfe91058e646c0d9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.182588:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626400/0xfe91058e646c0d9b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.182596:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626400/0xfe91058e646c0d9b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.182603:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a04626400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:3.0:1787574468.182609:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626400/0xfe91058e646c0d9b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.182618:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626400/0xfe91058e646c0d9b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.182634:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982a04dc0200) 00010000:00010000:3.0:1787574468.182637:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787574468.182642:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626400/0xfe91058e646c0d9b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.182659:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626400/0xfe91058e646c0d9b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.182709:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626200/0xfe91058e646c0d94 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f039 expref: 26 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.182719:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982a04dc0b00) 00010000:00010000:3.0:1787574468.182722:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787574468.182726:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626200/0xfe91058e646c0d94 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f039 expref: 26 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.182737:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a04626200, rc 0) 00000100:00100000:3.0:1787574468.182812:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb815d5e-9f9e-47fd-838c-222c53157044+25:14478:x1874407272342144:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 727us (1066us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1787574468.182820:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:2.0:1787574468.195298:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574468.195472:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272342272 00000100:00100000:1.0:1787574468.195483:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272342272 00000100:00100000:1.0:1787574468.195546:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:1.0:1787574468.195557:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb815d5e-9f9e-47fd-838c-222c53157044+25:14478:x1874407272342272:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787574468.195591:0:15671:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787574468.195702:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb815d5e-9f9e-47fd-838c-222c53157044+25:14478:x1874407272342272:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 146us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574468.195709:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:0.0:1787574468.198265:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574468.198833:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272342528 00000100:00100000:1.0:1787574468.198849:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272342528 00000100:00100000:1.0:1787574468.198934:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:1.0:1787574468.198948:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb815d5e-9f9e-47fd-838c-222c53157044+25:14478:x1874407272342528:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787574468.198975:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574468.199004:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0da9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1f040 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787574468.202120:0:14326:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1787574468.202133:0:14326:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1787574468.202306:0:14326:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1787574468.202665:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6800/0xfe91058e646c0db0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.202687:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6800/0xfe91058e646c0db0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.202701:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6800/0xfe91058e646c0db0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.202794:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1000/0xfe91058e646c0da9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f040 expref: 28 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.202817:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6800/0xfe91058e646c0db0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f040 expref: 27 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.202828:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff982a0296be00) 00010000:00010000:0.0:1787574468.202831:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574468.202835:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a048f6800, rc 0) 00000100:00100000:0.0:1787574468.202931:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb815d5e-9f9e-47fd-838c-222c53157044+27:14478:x1874407272342528:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 3984us (4677us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1787574468.203008:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:3.0:1787574468.205707:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574468.206250:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272342784 00000100:00100000:1.0:1787574468.206266:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272342784 00000100:00100000:1.0:1787574468.206340:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:1.0:1787574468.206368:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb815d5e-9f9e-47fd-838c-222c53157044+27:14478:x1874407272342784:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787574468.206696:0:15671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574468.206737:0:15671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6800/0xfe91058e646c0db0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f040 expref: 27 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.206793:0:15671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff982a0296be00) 00010000:00010000:1.0:1787574468.206807:0:15671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787574468.207798:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0dbe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.208093:0:15671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0dbe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.208109:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0dbe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.208131:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0dc5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb9b28c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.208138:0:15671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb9b28c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.208144:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb9b28c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.208264:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0dbe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.208273:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0dbe lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.208281:0:15671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0dbe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.208288:0:15671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574468.208293:0:15671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0dbe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.208313:0:15671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0dbe lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.208327:0:15671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff982a03b34900) 00010000:00010000:1.0:1787574468.208330:0:15671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574468.208334:0:15671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0dbe lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.208341:0:15671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1c00/0xfe91058e646c0dbe lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.208367:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb9b28c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.208373:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0dc5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb9b28c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.208378:0:15671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0dc5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb9b28c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.208383:0:15671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574468.208385:0:15671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0dc5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb9b28c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.208391:0:15671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0dc5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb9b28c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.208397:0:15671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xb9b28c8 (ffff982a04da2f00) 00010000:00010000:1.0:1787574468.208399:0:15671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574468.208402:0:15671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0dc5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb9b28c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.208419:0:15671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0dc5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb9b28c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574468.208563:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb815d5e-9f9e-47fd-838c-222c53157044+26:14478:x1874407272342784:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 2207us (2864us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787574468.208573:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:2.0:1787574468.221297:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574468.221397:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272342912 00000100:00100000:3.0:1787574468.221409:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272342912 00000100:00100000:3.0:1787574468.221475:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:3.0:1787574468.221487:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb815d5e-9f9e-47fd-838c-222c53157044+26:14478:x1874407272342912:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574468.221526:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574468.221557:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626200/0xfe91058e646c0dcc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1f047 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.221863:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626400/0xfe91058e646c0dd3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.221901:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626400/0xfe91058e646c0dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.221916:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626400/0xfe91058e646c0dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.222048:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626200/0xfe91058e646c0dcc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f047 expref: 28 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.222070:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626400/0xfe91058e646c0dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f047 expref: 27 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.222081:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff982a04dc0100) 00010000:00010000:3.0:1787574468.222084:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787574468.222088:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a04626400, rc 0) 00000100:00100000:3.0:1787574468.222397:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb815d5e-9f9e-47fd-838c-222c53157044+27:14478:x1874407272342912:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 910us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574468.222407:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:3.0:1787574468.234475:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574468.234973:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272343168 00000100:00100000:1.0:1787574468.234986:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272343168 00000100:00100000:1.0:1787574468.235072:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:1.0:1787574468.235085:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb815d5e-9f9e-47fd-838c-222c53157044+27:14478:x1874407272343168:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787574468.235256:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0dda lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.235278:0:15671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0dda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.235291:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0dda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787574468.236272:0:15671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1787574468.236291:0:15671:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 444411124300ns, next at 445411119925ns, rc = 0 00000004:00010000:0.0:1787574468.236426:0:15671:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000cc13398 reply state 000000007fd73bcd transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0dda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574468.236440:0:15671:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574468.236638:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb815d5e-9f9e-47fd-838c-222c53157044+29:14478:x1874407272343168:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 1550us (2173us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1787574468.236648:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:0.0:1787574468.245252:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1787574468.245682:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0dda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.245698:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0dda lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.245707:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0dda lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.245714:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e1200 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:1.0:1787574468.245740:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0dda lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.245750:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0dda lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.245774:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff982a04dc0100) 00010000:00010000:1.0:1787574468.245778:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787574468.245784:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0dda lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.245791:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e1200/0xfe91058e646c0dda lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574468.246007:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272343296 00000100:00100000:3.0:1787574468.246022:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272343296 00000100:00100000:3.0:1787574468.246079:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:3.0:1787574468.246090:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb815d5e-9f9e-47fd-838c-222c53157044+28:14478:x1874407272343296:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574468.246118:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574468.246138:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626200/0xfe91058e646c0de1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1f04e expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.246253:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626200/0xfe91058e646c0de1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f04e expref: 29 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.246267:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626200/0xfe91058e646c0de1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f04e expref: 29 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.246287:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff982a04dc0100) 00010000:00010000:3.0:1787574468.246290:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574468.246292:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a04626200, rc 0) 00000100:00100000:0.0:1787574468.246831:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb815d5e-9f9e-47fd-838c-222c53157044+29:14478:x1874407272343296:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 732us (1582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574468.246841:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:3.0:1787574468.249140:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574468.249386:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272343424 00000100:00100000:0.0:1787574468.249414:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272343424 00000100:00100000:0.0:1787574468.249490:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:0.0:1787574468.249502:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb815d5e-9f9e-47fd-838c-222c53157044+5:2352:x1874407272343424:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787574468.249992:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb815d5e-9f9e-47fd-838c-222c53157044+6:2352:x1874407272343424:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 491us (862us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787574468.250002:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:3.0:1787574468.253103:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574468.253231:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272343680 00000100:00100000:0.0:1787574468.253244:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272343680 00000100:00100000:0.0:1787574468.253314:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:0.0:1787574468.253328:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cb815d5e-9f9e-47fd-838c-222c53157044+29:14478:x1874407272343680:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787574468.253665:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cb815d5e-9f9e-47fd-838c-222c53157044+30:14478:x1874407272343680:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 338us (574us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1787574468.253673:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:3.0:1787574468.256477:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574468.256597:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272343936 00000100:00100000:0.0:1787574468.256619:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272343936 00000100:00100000:0.0:1787574468.256757:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:0.0:1787574468.256769:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb815d5e-9f9e-47fd-838c-222c53157044+30:14478:x1874407272343936:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787574468.256927:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb815d5e-9f9e-47fd-838c-222c53157044+30:14478:x1874407272343936:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 159us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574468.256935:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:2.0:1787574468.260828:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574468.261013:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272344064 00000100:00100000:0.0:1787574468.261035:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272344064 00000100:00100000:0.0:1787574468.261107:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:0.0:1787574468.261119:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb815d5e-9f9e-47fd-838c-222c53157044+30:14478:x1874407272344064:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574468.261146:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574468.261232:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7400/0xfe91058e646c0de8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1f055 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.261328:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0def lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.261346:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0def lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.261400:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0def lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574468.261447:0:14326:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787574468.261468:0:14326:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0def lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.261499:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7400/0xfe91058e646c0de8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f055 expref: 32 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.261520:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0def lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f055 expref: 31 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.261530:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff982a04dc0100) 00010000:00010000:0.0:1787574468.261533:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787574468.261537:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a048f6c00, rc 0) 00000100:00100000:0.0:1787574468.261839:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb815d5e-9f9e-47fd-838c-222c53157044+31:14478:x1874407272344064:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 721us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574468.261849:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:1.0:1787574468.265947:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574468.266074:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272344192 00000100:00100000:0.0:1787574468.266089:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272344192 00000100:00100000:0.0:1787574468.266215:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:0.0:1787574468.266228:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cb815d5e-9f9e-47fd-838c-222c53157044+6:2351:x1874407272344192:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574468.266252:0:15006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574468.266279:0:15006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068759d09/0xfe91058e646c0df6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b695f335c1f05c expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787574468.266314:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c38c4, blocks: 0x1 00010000:00010000:0.0:1787574468.266338:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1787574468.266343:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574468.267125:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068759d09/0xfe91058e646c0df6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f05c expref: 7 pid: 15006 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.267158:0:15006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000068759d09/0xfe91058e646c0df6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f05c expref: 7 pid: 15006 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.267399:0:15006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982a048f7200, rc 0) 00000100:00100000:0.0:1787574468.267505:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cb815d5e-9f9e-47fd-838c-222c53157044+7:2351:x1874407272344192:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1279us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574468.267516:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:3.0:1787574468.271407:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574468.271530:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272344448 00000100:00100000:0.0:1787574468.271544:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272344448 00000100:00100000:0.0:1787574468.271625:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:0.0:1787574468.271639:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb815d5e-9f9e-47fd-838c-222c53157044+31:14478:x1874407272344448:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787574468.271774:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb815d5e-9f9e-47fd-838c-222c53157044+31:14478:x1874407272344448:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 138us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574468.271781:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:2.0:1787574468.277536:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574468.277812:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272344576 00000100:00100000:0.0:1787574468.277889:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272344576 00000100:00100000:0.0:1787574468.278001:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:0.0:1787574468.278021:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb815d5e-9f9e-47fd-838c-222c53157044+31:14478:x1874407272344576:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787574468.346226:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb815d5e-9f9e-47fd-838c-222c53157044+31:14478:x1874407272344576:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 68204us (68694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574468.346239:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 51 00000001:00080000:2.0:1787574468.346882:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:2.0:1787574468.346916:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000004:00080000:2.0:1787574468.346927:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787574468.346947:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:2.0:1787574468.346956:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1787574468.347930:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290150272:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787574468.347990:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574468.348394:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290150272 00000100:00100000:1.0:1787574468.348402:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290150272 00000100:00080000:2.0:1787574468.348643:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574468.348722:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787574468.348733:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874407290150272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787574468.348803:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00002000:00010000:1.0:1787574468.348908:0:15009:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787574468.348912:0:15009:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787574468.348914:0:15009:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787574468.348916:0:15009:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787574468 -> 1787574468 00002000:00010000:1.0:1787574468.348919:0:15009:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787574468.348958:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1874407290150272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 228us (968us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787574468.348965:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787574468.348981:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272344704 00000100:00100000:1.0:1787574468.348984:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272344704 00000100:00100000:1.0:1787574468.349018:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000004:00080000:0.0:1787574468.349026:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982a419b4a80/2, rc 0, transno 8589934595 00000100:00100000:0.0:1787574468.349032:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874407290150272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787574468.349036:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb815d5e-9f9e-47fd-838c-222c53157044+7:2350:x1874407272344704:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787574468.349103:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb815d5e-9f9e-47fd-838c-222c53157044+7:2350:x1874407272344704:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 67us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574468.349110:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1787574468.352102:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574468.352200:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272344960 00000100:00100000:0.0:1787574468.352209:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272344960 00000100:00100000:0.0:1787574468.352266:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:0.0:1787574468.352276:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb815d5e-9f9e-47fd-838c-222c53157044+14:14478:x1874407272344960:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787574468.352328:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574468.352366:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f6c00/0xfe91058e646c0def lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f055 expref: 14 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.352383:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff982a04dc0100) 00010000:00010000:0.0:1787574468.352388:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574468.352423:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0dfd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.352436:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0dfd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.352465:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0dfd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574468.352714:0:14325:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045db5f0e reply state 000000002a10e0bf transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0dfd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574468.352723:0:14325:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574468.352816:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb815d5e-9f9e-47fd-838c-222c53157044+15:14478:x1874407272344960:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 540us (730us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787574468.352824:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 52 00010000:00010000:2.0:1787574468.354586:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0dfd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.354601:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0dfd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.354608:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0dfd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.354615:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a048f7600 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574468.354619:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0dfd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.354627:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0dfd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.354653:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff982a04dc0100) 00010000:00010000:2.0:1787574468.354656:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574468.354660:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0dfd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.354666:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a048f7600/0xfe91058e646c0dfd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574468.355749:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574468.357478:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272345088 00000100:00100000:0.0:1787574468.357491:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272345088 00000100:00100000:0.0:1787574468.357561:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:0.0:1787574468.357572:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb815d5e-9f9e-47fd-838c-222c53157044+7:2351:x1874407272345088:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787574468.357769:0:15009:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787574468.357774:0:15009:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787574467 00002000:00010000:0.0:1787574468.357776:0:15009:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787574467 00002000:00010000:0.0:1787574468.357779:0:15009:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787574468 -> 1787574467 00002000:00010000:0.0:1787574468.357781:0:15009:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787574468.357852:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb815d5e-9f9e-47fd-838c-222c53157044+8:2351:x1874407272345088:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 280us (2106us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787574468.357859:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:0.0:1787574468.361752:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574468.361956:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272345216 00000100:00100000:2.0:1787574468.361965:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272345216 00000100:00100000:2.0:1787574468.362014:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:2.0:1787574468.362025:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb815d5e-9f9e-47fd-838c-222c53157044+8:2350:x1874407272345216:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787574468.362070:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cf13f0d8/0xfe91058e646c0e04 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.362086:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574468.362090:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574468.362096:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf13f0d8/0xfe91058e646c0e04 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.362110:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf13f0d8/0xfe91058e646c0e04 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.362136:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cf13f0d8/0xfe91058e646c0e04 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.362160:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf13f0d8/0xfe91058e646c0e04 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.362210:0:15008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf13f0d8/0xfe91058e646c0e04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.362217:0:15008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fae00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574468.362222:0:15008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf13f0d8/0xfe91058e646c0e04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.362230:0:15008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf13f0d8/0xfe91058e646c0e04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.362246:0:15008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf13f0d8/0xfe91058e646c0e04 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.362254:0:15008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf13f0d8/0xfe91058e646c0e04 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574468.362525:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb815d5e-9f9e-47fd-838c-222c53157044+8:2350:x1874407272345216:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 501us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574468.362533:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:1.0:1787574468.365977:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574468.366068:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272345472 00000100:00100000:2.0:1787574468.366077:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272345472 00000100:00100000:2.0:1787574468.366156:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:2.0:1787574468.366206:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb815d5e-9f9e-47fd-838c-222c53157044+14:14478:x1874407272345472:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787574468.366284:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0e0b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.366313:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0e0b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.366324:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0e0b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.366583:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e12 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.366594:0:14324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626200/0xfe91058e646c0de1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f04e expref: 15 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.366602:0:14324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e12 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.366633:0:14324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626200/0xfe91058e646c0de1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f04e expref: 15 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.366646:0:14324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626200/0xfe91058e646c0de1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f04e expref: 15 pid: 14326 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574468.366660:0:14324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14324:1874407290150400:192.168.206.51@tcp:104: 00000100:00100000:2.0:1787574468.366741:0:14324:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a26fc6180 going to sleep for 11 seconds 00000100:00100000:1.0:1787574468.372715:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574468.373035:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272345600 00000100:00100000:0.0:1787574468.373045:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272345600 00010000:00010000:0.0:1787574468.373085:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626200/0xfe91058e646c0de1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f04e expref: 16 pid: 14326 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574468.373161:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:0.0:1787574468.373202:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb815d5e-9f9e-47fd-838c-222c53157044+16:2351:x1874407272345600:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574468.373219:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574468.373227:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626200/0xfe91058e646c0de1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f04e expref: 16 pid: 14326 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.373239:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626200/0xfe91058e646c0de1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f04e expref: 16 pid: 14326 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.373262:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff982a04dc0100) 00010000:00010000:0.0:1787574468.373267:0:14311:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e12 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.373277:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e12 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.373297:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e12 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.373314:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574468.373368:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb815d5e-9f9e-47fd-838c-222c53157044+16:2351:x1874407272345600:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 170us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574468.373376:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00010000:00010000:2.0:1787574468.373875:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a04626200/0xfe91058e646c0de1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f04e expref: 15 pid: 14326 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574468.373894:0:14324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14324:1874407290150400:192.168.206.51@tcp:104: 00010000:00010000:2.0:1787574468.373916:0:14324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e12 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.373934:0:14324:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e12 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.374325:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e12 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787574468.374524:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787574468.374671:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787574468.374729:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787574468.374810:0:14324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14324:1874407290150528:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787574468.374907:0:14324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574468.374945:0:14324:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0828c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574468.375455:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290150528 00000100:00100000:3.0:1787574468.375462:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290150528 00000100:00100000:3.0:1787574468.375508:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787574468.375518:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14324:x1874407290150528:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787574468.375628:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14324:x1874407290150528:12345-0@lo:1000:mdt00_000.0 Request processed in 110us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574468.375635:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574468.375678:0:14324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14324:1874407290150528:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787574468.376905:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787574468.376986:0:14324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14324:1874407290150656:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787574468.377037:0:14324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574468.377650:0:14324:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0828cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574468.378042:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290150656 00000100:00100000:0.0:1787574468.378052:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290150656 00000100:00100000:0.0:1787574468.378096:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574468.378106:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14324:x1874407290150656:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787574468.378324:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14324:x1874407290150656:12345-0@lo:1000:mdt00_000.0 Request processed in 219us (1286us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787574468.378332:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787574468.378516:0:14324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14324:1874407290150656:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787574468.378553:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e12 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.378563:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e12 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.378571:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e12 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.378577:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fac00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574468.378589:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e12 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.378596:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e12 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.378611:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff982a04dc0100) 00010000:00010000:2.0:1787574468.378614:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787574468.378618:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e12 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.378624:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e12 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.378657:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0d71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.378673:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0d71 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.378679:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0d71 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.378684:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a057e0c00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574468.378687:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0d71 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.378692:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0d71 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.378700:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982a04dc0200) 00010000:00010000:2.0:1787574468.378702:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787574468.378723:0:14324:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627800/0xfe91058e646c0d78 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f032 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.378734:0:14324:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627800/0xfe91058e646c0d78 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f032 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.378742:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627800/0xfe91058e646c0d78 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f032 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.378772:0:14324:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff982a04627800/0xfe91058e646c0d78 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f032 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574468.378784:0:14324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14324:1874407290150784:192.168.206.51@tcp:105: 00000100:00100000:2.0:1787574468.378839:0:14324:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0828cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574468.385814:0:14324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14324:1874407290150784:192.168.206.51@tcp:105: 00010000:00010000:2.0:1787574468.385845:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0d71 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.385855:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a057e0c00/0xfe91058e646c0d71 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.385884:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e19 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.385897:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e19 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.385907:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e19 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.385933:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e19 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.385940:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e19 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.385946:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e19 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.385952:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fac00 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574468.385956:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e19 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.385963:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e19 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.385975:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982a04dc0200) 00010000:00010000:2.0:1787574468.385978:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574468.385982:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e19 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.385988:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fac00/0xfe91058e646c0e19 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.385997:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0e0b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.386003:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0e0b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.386008:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0e0b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.386030:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fa400 already unused, calling callback (ffffffffc1e394f0) 00010000:00010000:2.0:1787574468.386033:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0e0b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.386040:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0e0b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.386048:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982a04dc0200) 00010000:00010000:2.0:1787574468.386051:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787574468.386053:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0e0b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.386058:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0e0b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574468.386328:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb815d5e-9f9e-47fd-838c-222c53157044+18:14478:x1874407272345472:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 20161us (20358us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787574468.386338:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 53 00000020:00080000:2.0:1787574468.386343:0:14324:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787574468.389848:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787574468.389857:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787574468.389888:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787574468.389894:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787574468.391502:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574468.391726:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272345728 00000100:00100000:2.0:1787574468.391736:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272345728 00000100:00100000:2.0:1787574468.391805:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:2.0:1787574468.391816:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a04e94050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cb815d5e-9f9e-47fd-838c-222c53157044+18:14477:x1874407272345728:12345-192.168.206.51@tcp:49:dd.0 00000100:00100000:2.0:1787574468.392003:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a04e94050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cb815d5e-9f9e-47fd-838c-222c53157044+18:14477:x1874407272345728:12345-192.168.206.51@tcp:49:dd.0 Request processed in 187us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574468.392011:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:0.0:1787574468.402031:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574468.402693:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272345984 00000100:00100000:2.0:1787574468.402704:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272345984 00000100:00100000:2.0:1787574468.402799:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:2.0:1787574468.403021:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cb815d5e-9f9e-47fd-838c-222c53157044+18:14478:x1874407272345984:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787574468.404474:0:14328:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787574468.404717:0:14328:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787574468.405674:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0e20 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.405694:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0e20 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.405705:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0e20 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.405714:0:14328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0e20 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.405722:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0e20 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.405728:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0e20 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.405776:0:14328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787574468.405886:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cb815d5e-9f9e-47fd-838c-222c53157044+20:14478:x1874407272345984:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 3075us (3881us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787574468.405897:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000020:00080000:2.0:1787574468.405902:0:14328:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787574468.406198:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574468.406216:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0e20 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.406223:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fa400 already unused, calling callback (ffffffffc142f230) 00010000:00010000:3.0:1787574468.406228:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0e20 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.406236:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0e20 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.406249:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff982a04dc0100) 00010000:00010000:3.0:1787574468.406252:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787574468.406256:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0e20 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.406262:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982a069fa400/0xfe91058e646c0e20 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.406275:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574468.406276:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574468.406278:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574468.637681:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574468.637723:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574468.637767:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574468.637804:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1787574468.637938:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272346112 00000100:00100000:2.0:1787574468.637948:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272346112 00000100:00100000:2.0:1787574468.637995:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272346240 00000100:00100000:2.0:1787574468.637999:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272346240 00000100:00100000:2.0:1787574468.638031:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272346368 00000100:00100000:2.0:1787574468.638034:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272346368 00000100:00100000:2.0:1787574468.638045:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272346496 00000100:00100000:2.0:1787574468.638048:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272346496 00000100:00100000:2.0:1787574468.638064:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:2.0:1787574468.638073:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cb815d5e-9f9e-47fd-838c-222c53157044+11:2350:x1874407272346112:12345-192.168.206.51@tcp:4:dd.0 00010000:00010000:2.0:1787574468.638104:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a46ee6e9/0xfe91058e646c0e27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.638125:0:15014:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000068759d09/0xfe91058e646c0df6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f05c expref: 11 pid: 15006 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.638135:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574468.638139:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574468.638143:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a46ee6e9/0xfe91058e646c0e27 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.638212:0:15014:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000068759d09/0xfe91058e646c0df6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f05c expref: 11 pid: 15006 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.638239:0:15014:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000068759d09/0xfe91058e646c0df6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f05c expref: 11 pid: 15006 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574468.638254:0:15014:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:15014:1874407290150912:192.168.206.51@tcp:104: 00000100:00100000:2.0:1787574468.638343:0:15014:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a0828c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574468.638735:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1787574468.639015:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787574468.639023:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1787574468.639308:0:15013:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787574468.639320:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272346624 00000100:00100000:2.0:1787574468.639332:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272346624 00000100:00100000:0.0:1787574468.640606:0:16558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:0.0:1787574468.640621:0:16558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cb815d5e-9f9e-47fd-838c-222c53157044+12:2350:x1874407272346240:12345-192.168.206.51@tcp:4:dd.0 00010000:00010000:0.0:1787574468.640655:0:16558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee260752/0xfe91058e646c0e2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.640672:0:16558:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574468.640677:0:16558:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574468.640680:0:16558:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee260752/0xfe91058e646c0e2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.640689:0:16558:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ee260752/0xfe91058e646c0e2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574468.640961:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574468.641021:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574468.641161:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272347008 00000100:00100000:1.0:1787574468.641201:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272347008 00010000:00010000:1.0:1787574468.641244:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000068759d09/0xfe91058e646c0df6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f05c expref: 13 pid: 15006 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574468.641272:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:1.0:1787574468.641280:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb815d5e-9f9e-47fd-838c-222c53157044+13:2351:x1874407272347008:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574468.641290:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574468.641309:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000068759d09/0xfe91058e646c0df6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f05c expref: 13 pid: 15006 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.641322:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000068759d09/0xfe91058e646c0df6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f05c expref: 13 pid: 15006 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.641341:0:14310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574468.641354:0:14310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574468.641360:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a46ee6e9/0xfe91058e646c0e27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.641381:0:14310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a46ee6e9/0xfe91058e646c0e27 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.641390:0:14310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574468.641393:0:14310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574468.641396:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ee260752/0xfe91058e646c0e2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.641408:0:14310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee260752/0xfe91058e646c0e2e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.641429:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574468.641471:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb815d5e-9f9e-47fd-838c-222c53157044+13:2351:x1874407272347008:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 193us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574468.641478:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:2.0:1787574468.641700:0:15013:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787574468.641709:0:15013:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00010000:00010000:0.0:1787574468.643690:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068759d09/0xfe91058e646c0df6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xc0b695f335c1f05c expref: 12 pid: 15006 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574468.643715:0:15014:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:15014:1874407290150912:192.168.206.51@tcp:104: 00010000:00010000:0.0:1787574468.643737:0:15014:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a46ee6e9/0xfe91058e646c0e27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.643780:0:15014:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a46ee6e9/0xfe91058e646c0e27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.643786:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a46ee6e9/0xfe91058e646c0e27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.644799:0:16558:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ee260752/0xfe91058e646c0e2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.644813:0:16558:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee260752/0xfe91058e646c0e2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574468.648575:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1787574468.648695:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787574468.648706:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272346752 00000100:00100000:1.0:1787574468.648715:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272346752 00000100:00100000:1.0:1787574468.648779:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787574468.648785:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272346880 00000100:00100000:1.0:1787574468.648788:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272346880 00000100:00100000:3.0:1787574468.651096:0:16559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:3.0:1787574468.651115:0:16559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cb815d5e-9f9e-47fd-838c-222c53157044+15:2350:x1874407272346368:12345-192.168.206.51@tcp:4:dd.0 00010000:00010000:3.0:1787574468.651187:0:16559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1342ba9/0xfe91058e646c0e35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.651206:0:16559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574468.651210:0:16559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574468.651217:0:16559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1342ba9/0xfe91058e646c0e35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.651232:0:16559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1342ba9/0xfe91058e646c0e35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574468.652506:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1787574468.658774:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1787574468.658788:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:3.0:1787574468.660659:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407272347136 00000100:00100000:3.0:1787574468.660670:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407272347136 00000100:00100000:2.0:1787574468.661764:0:16560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:2.0:1787574468.661780:0:16560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cb815d5e-9f9e-47fd-838c-222c53157044+17:2350:x1874407272346496:12345-192.168.206.51@tcp:4:dd.0 00010000:00010000:2.0:1787574468.661814:0:16560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646c0e3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.661830:0:16560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574468.661834:0:16560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574468.661841:0:16560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646c0e3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.661854:0:16560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646c0e3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787574468.784506:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1787574468.784523:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:3.0:1787574468.784536:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:2.0:1787574468.784703:0:15014:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1787574468.784709:0:15014:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787574467 -> 1787574468 00002000:00010000:2.0:1787574468.784712:0:15014:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787574467 -> 1787574468 00002000:00010000:2.0:1787574468.784714:0:15014:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1787574468.784729:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a46ee6e9/0xfe91058e646c0e27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.784742:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a46ee6e9/0xfe91058e646c0e27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.784752:0:15014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a46ee6e9/0xfe91058e646c0e27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.784772:0:15014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fac00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:2.0:1787574468.784777:0:15014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a46ee6e9/0xfe91058e646c0e27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.784787:0:15014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a46ee6e9/0xfe91058e646c0e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.784808:0:15014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a46ee6e9/0xfe91058e646c0e27 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.784827:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a46ee6e9/0xfe91058e646c0e27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574468.784917:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cb815d5e-9f9e-47fd-838c-222c53157044+21:2350:x1874407272346112:12345-192.168.206.51@tcp:4:dd.0 Request processed in 146841us (147240us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1787574468.784926:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:2.0:1787574468.784953:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:2.0:1787574468.784964:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a419b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cb815d5e-9f9e-47fd-838c-222c53157044+20:2350:x1874407272346624:12345-192.168.206.51@tcp:4:dd.0 00010000:00010000:2.0:1787574468.784992:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4bee411/0xfe91058e646c0e43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.785004:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574468.785008:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574468.785396:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574468.785448:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4bee411/0xfe91058e646c0e43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574468.785476:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4bee411/0xfe91058e646c0e43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787574468.885817:0:16560:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:1.0:1787574468.885827:0:16560:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 8199 00010000:00010000:1.0:1787574468.885843:0:16560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646c0e3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.885873:0:16560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646c0e3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.885883:0:16560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646c0e3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.885891:0:16560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fba00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574468.885896:0:16560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646c0e3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.885906:0:16560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646c0e3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.885929:0:16560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646c0e3c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574468.885938:0:16560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000505d6361/0xfe91058e646c0e3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574468.886074:0:16560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cb815d5e-9f9e-47fd-838c-222c53157044+22:2350:x1874407272346496:12345-192.168.206.51@tcp:4:dd.0 Request processed in 224293us (248263us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787574468.886085:0:16560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000001:00080000:2.0:1787574468.886202:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1787574468.886221:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00010000:00010000:0.0:1787574468.886260:0:16558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee260752/0xfe91058e646c0e2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.886271:0:16558:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee260752/0xfe91058e646c0e2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.886278:0:16558:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee260752/0xfe91058e646c0e2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.886285:0:16558:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a048f6c00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574468.886288:0:16558:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee260752/0xfe91058e646c0e2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.886307:0:16558:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee260752/0xfe91058e646c0e2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.886321:0:16558:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee260752/0xfe91058e646c0e2e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.886328:0:16558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee260752/0xfe91058e646c0e2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574468.886379:0:16558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cb815d5e-9f9e-47fd-838c-222c53157044+14:2350:x1874407272346240:12345-192.168.206.51@tcp:4:dd.0 Request processed in 245761us (248654us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787574468.886389:0:16558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:0.0:1787574468.886414:0:16558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:0.0:1787574468.886426:0:16558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cb815d5e-9f9e-47fd-838c-222c53157044+13:2350:x1874407272346752:12345-192.168.206.51@tcp:4:dd.0 00010000:00010000:0.0:1787574468.886457:0:16558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000220d54dc/0xfe91058e646c0e4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.886469:0:16558:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787574468.886473:0:16558:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574468.886479:0:16558:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000220d54dc/0xfe91058e646c0e4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.886491:0:16558:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000220d54dc/0xfe91058e646c0e4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.886633:0:16559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1342ba9/0xfe91058e646c0e35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.886642:0:16559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1342ba9/0xfe91058e646c0e35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.886649:0:16559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1342ba9/0xfe91058e646c0e35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.886655:0:16559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a04627a00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:0.0:1787574468.886658:0:16559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1342ba9/0xfe91058e646c0e35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.886665:0:16559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1342ba9/0xfe91058e646c0e35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.886676:0:16559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1342ba9/0xfe91058e646c0e35 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.886684:0:16559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1342ba9/0xfe91058e646c0e35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574468.886721:0:16559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cb815d5e-9f9e-47fd-838c-222c53157044+13:2350:x1874407272346368:12345-192.168.206.51@tcp:4:dd.0 Request processed in 235612us (248960us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787574468.886727:0:16559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:0.0:1787574468.886751:0:16559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:0.0:1787574468.886759:0:16559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a8a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cb815d5e-9f9e-47fd-838c-222c53157044+12:2351:x1874407272346880:12345-192.168.206.51@tcp:4:dd.0 00010000:00010000:0.0:1787574468.886777:0:16559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003520bd9d/0xfe91058e646c0e51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.886786:0:16559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574468.886789:0:16559:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574468.886793:0:16559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003520bd9d/0xfe91058e646c0e51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.886803:0:16559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003520bd9d/0xfe91058e646c0e51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574468.890492:0:16560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:0.0:1787574468.890512:0:16560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a3a6cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cb815d5e-9f9e-47fd-838c-222c53157044+12:2350:x1874407272347136:12345-192.168.206.51@tcp:4:dd.0 00010000:00010000:0.0:1787574468.890623:0:16560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000325bb450/0xfe91058e646c0e58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.890640:0:16560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574468.890644:0:16560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574468.890650:0:16560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000325bb450/0xfe91058e646c0e58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574468.890665:0:16560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000325bb450/0xfe91058e646c0e58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787574468.986848:0:15014:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7654321 00002000:00010000:3.0:1787574468.986858:0:15014:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:3.0:1787574468.986872:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4bee411/0xfe91058e646c0e43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.986887:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4bee411/0xfe91058e646c0e43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.986896:0:15014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4bee411/0xfe91058e646c0e43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.986922:0:15014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a069fa800 already unused, calling callback (ffffffffc142f230) 00010000:00010000:3.0:1787574468.986928:0:15014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4bee411/0xfe91058e646c0e43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.986937:0:15014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4bee411/0xfe91058e646c0e43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.986956:0:15014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4bee411/0xfe91058e646c0e43 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574468.986964:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4bee411/0xfe91058e646c0e43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574468.987054:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a419b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cb815d5e-9f9e-47fd-838c-222c53157044+19:2350:x1874407272346624:12345-192.168.206.51@tcp:4:dd.0 Request processed in 202089us (348314us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1787574468.987063:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000001:00080000:2.0:1787574468.987244:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:1.0:1787574469.051782:0:16560:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 16391 00010000:00010000:1.0:1787574469.051803:0:16560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000325bb450/0xfe91058e646c0e58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574469.051833:0:16560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000325bb450/0xfe91058e646c0e58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574469.051842:0:16560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000325bb450/0xfe91058e646c0e58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574469.051848:0:16560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a048f6200 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574469.051852:0:16560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000325bb450/0xfe91058e646c0e58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574469.051861:0:16560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000325bb450/0xfe91058e646c0e58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574469.051880:0:16560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000325bb450/0xfe91058e646c0e58 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574469.051888:0:16560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000325bb450/0xfe91058e646c0e58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574469.051978:0:16560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a6cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cb815d5e-9f9e-47fd-838c-222c53157044+15:2350:x1874407272347136:12345-192.168.206.51@tcp:4:dd.0 Request processed in 161470us (399486us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787574469.051988:0:16560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00010000:00010000:1.0:1787574469.052042:0:16559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003520bd9d/0xfe91058e646c0e51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574469.052061:0:16559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003520bd9d/0xfe91058e646c0e51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574469.052069:0:16559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003520bd9d/0xfe91058e646c0e51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574469.052075:0:16559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a048f6800 already unused, calling callback (ffffffffc142f230) 00010000:00010000:1.0:1787574469.052078:0:16559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003520bd9d/0xfe91058e646c0e51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574469.052085:0:16559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003520bd9d/0xfe91058e646c0e51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574469.052095:0:16559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003520bd9d/0xfe91058e646c0e51 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574469.052101:0:16559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003520bd9d/0xfe91058e646c0e51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574469.052132:0:16559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a3a8a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cb815d5e-9f9e-47fd-838c-222c53157044+13:2351:x1874407272346880:12345-192.168.206.51@tcp:4:dd.0 Request processed in 165374us (403567us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787574469.052139:0:16559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000001:00080000:2.0:1787574469.052324:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00000001:00080000:2.0:1787574469.052341:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:3.0:1787574469.055258:0:16558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000220d54dc/0xfe91058e646c0e4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574469.055278:0:16558:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000220d54dc/0xfe91058e646c0e4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574469.055287:0:16558:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000220d54dc/0xfe91058e646c0e4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574469.055309:0:16558:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982a048f6e00 already unused, calling callback (ffffffffc142f230) 00010000:00010000:3.0:1787574469.055315:0:16558:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000220d54dc/0xfe91058e646c0e4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574469.055323:0:16558:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000220d54dc/0xfe91058e646c0e4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574469.055356:0:16558:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000220d54dc/0xfe91058e646c0e4a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574469.055364:0:16558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000220d54dc/0xfe91058e646c0e4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574469.055502:0:16558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cb815d5e-9f9e-47fd-838c-222c53157044+5:2350:x1874407272346752:12345-192.168.206.51@tcp:4:dd.0 Request processed in 169074us (414537us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787574469.055513:0:16558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00010000:00010000:2.0:1787574469.810591:0:15901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574470.257377:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787574470.257466:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290151040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574470.257636:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574470.257701:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290151040 00000100:00100000:1.0:1787574470.257712:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290151040 00000100:00080000:2.0:1787574470.257790:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574470.257798:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787574470.257811:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290151040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574470.257870:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1787574470.257937:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874407290151040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574470.257945:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787574470.258026:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1787574470.258033:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982a419b4a80, transno 8589934595 00000100:00100000:3.0:1787574470.258190:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574470.258202:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a41d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290151168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574470.258237:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574470.258274:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290151168 00000100:00100000:3.0:1787574470.258278:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290151168 00000100:00100000:3.0:1787574470.258354:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787574470.258362:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290151168:12345-0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1787574470.258416:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1787574470.258456:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a419a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874407290151040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574470.258483:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874407290151424:0@lo:400:kworker.0 00000100:00100000:0.0:1787574470.258518:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574470.258559:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290151424 00000100:00100000:0.0:1787574470.258563:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290151424 00000100:00100000:2.0:1787574470.258587:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2841886-4ae8-43da-bc7c-46b9b13f805e:3300:1874407290151296:0@lo:400:kworker.0 00000100:00100000:0.0:1787574470.258596:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787574470.258605:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874407290151424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574470.258636:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1787574470.258700:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787574470.260018:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290151296 00000100:00100000:1.0:1787574470.260029:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290151296 00000100:00100000:1.0:1787574470.260080:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787574470.260089:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:3300:x1874407290151296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574470.260558:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2841886-4ae8-43da-bc7c-46b9b13f805e+19:3300:x1874407290151296:12345-0@lo:400:kworker.0 Request processed in 468us (1921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574470.260562:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874407290151168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2198us (2321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574470.260565:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2841886-4ae8-43da-bc7c-46b9b13f805e:3300:1874407290151296:0@lo:400:kworker.0 00000100:00100000:1.0:1787574470.260573:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787574470.260588:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787574470.260631:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290151552:0@lo:400:kworker.0 00000100:00100000:3.0:1787574470.260669:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574470.260724:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a41d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874407290151168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574470.260745:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574470.260752:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a3a6cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290151680:0@lo:400:kworker.0 00000100:00100000:3.0:1787574470.260775:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574470.260813:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290151552 00000100:00100000:3.0:1787574470.260817:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290151552 00000100:00100000:3.0:1787574470.260844:0:15671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407290151680 00000100:00100000:3.0:1787574470.260847:0:15671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407290151680 00000100:00100000:3.0:1787574470.260875:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787574470.260881:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290151552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574470.260924:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874407290151552:12345-0@lo:400:kworker.0 Request processed in 43us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574470.260931:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787574470.260943:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787574470.260950:0:15671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a41d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290151680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574470.260989:0:15671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874407290151680:12345-0@lo:400:kworker.0 Request processed in 39us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574470.260995:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1787574470.261015:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787574470.261020:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787574470.261038:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874407290151680:0@lo:400:kworker.0 00000100:00100000:3.0:1787574470.261047:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874407290151552:0@lo:400:kworker.0 00000100:00100000:0.0:1787574470.264787:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a41c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874407290151424:12345-0@lo:400:kworker.0 Request processed in 6170us (6256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574470.264803:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787574470.264905:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a3a6cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874407290151424:0@lo:400:kworker.0 00000001:02000400:0.0:1787574470.492161:0:16599:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1787574470.833458:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574471.857388:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29209 lines, 29209 kept, 0 dropped, 0 bad.